2024-09-16T06:33:32.542 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T06:33:32.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T06:33:32.640 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574 branch: reef description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/workunits} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906574' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 2 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mgr ttl cache expire seconds: 0 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: ae7f37330c1a72493684eb1fcaed6f2a01195bb6 owner: scheduled_teuthology@teuthology priority: 931 repo: https://git.ceph.com/ceph.git roles: - - mgr.x - mon.a - mon.c - mds.a - mds.c - osd.0 - client.0 - - mgr.y - mgr.z - mon.b - mds.b - osd.1 - osd.2 - osd.3 - client.1 seed: 1390 sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 sleep_before_teardown: 0 subset: 5319/100000 suite: rados suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ae7f37330c1a72493684eb1fcaed6f2a01195bb6 targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAUQEvIcRAGzwIJ5py/x/mOaYHE1GGXu4ES6E5yIZmn0M9Li9YKfDZuEIu5pw4TOr0YB+OdUEtOv6XHgi2xl7hI= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdhVaAJv0Lhq8WgPNw9gNBkEvJHlBbivkqIGRNdFb0vbPXAIGedhpdSnqk5Jjfjs2kCmPOEzo7ZOC6ZOupxMSE= tasks: - install: null - ceph: log-ignorelist: - overall HEALTH_ - \(MGR_DOWN\) - \(PG_ - replacing it with standby - No standby daemons available - \(POOL_APP_NOT_ENABLED\) wait-for-scrub: false - workunit: clients: client.0: - mgr/test_localpool.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_22:00:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T06:33:32.640 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa; will attempt to use it 2024-09-16T06:33:32.641 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa/tasks 2024-09-16T06:33:32.641 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T06:33:32.643 INFO:teuthology.task.internal:Checking packages... 2024-09-16T06:33:32.666 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8' 2024-09-16T06:33:32.667 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T06:33:32.667 INFO:teuthology.packaging:ref: None 2024-09-16T06:33:32.667 INFO:teuthology.packaging:tag: None 2024-09-16T06:33:32.667 INFO:teuthology.packaging:branch: reef 2024-09-16T06:33:32.667 INFO:teuthology.packaging:sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T06:33:32.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-09-16T06:33:32.886 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-853-gae7f3733-1jammy 2024-09-16T06:33:32.887 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T06:33:32.894 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T06:33:32.895 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T06:33:32.943 INFO:teuthology.task.internal:Saving configuration 2024-09-16T06:33:32.958 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T06:33:32.965 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T06:33:32.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 06:27:58.507525', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILl6RTd4qNlOz6OAHJQoeSS/zZK3D8Jw720MxnzaKyXo'} 2024-09-16T06:33:33.010 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 06:27:58.509307', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILOEk6SNAyu+a5GseRY2YOO3orhiC83nlUx9nBIdwkiw'} 2024-09-16T06:33:33.010 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T06:33:33.016 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'] 2024-09-16T06:33:33.016 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1'] 2024-09-16T06:33:33.016 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T06:33:33.074 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6e61aef250>, signals=[15]) 2024-09-16T06:33:33.074 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T06:33:33.081 INFO:teuthology.task.internal:Opening connections... 2024-09-16T06:33:33.081 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-09-16T06:33:33.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:33:33.167 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:33:33.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:33:33.250 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T06:33:33.257 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-09-16T06:33:33.262 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-09-16T06:33:33.262 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-09-16T06:33:33.309 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T06:33:33.309 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-09-16T06:33:33.309 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="22.04" 2024-09-16T06:33:33.309 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T06:33:33.309 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=jammy 2024-09-16T06:33:33.309 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-09-16T06:33:33.310 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-09-16T06:33:33.310 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T06:33:33.310 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T06:33:33.310 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T06:33:33.310 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T06:33:33.310 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=jammy 2024-09-16T06:33:33.310 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-09-16T06:33:33.334 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-16T06:33:33.338 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-16T06:33:33.339 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T06:33:33.384 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T06:33:33.385 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T06:33:33.385 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T06:33:33.385 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-09-16T06:33:33.385 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-16T06:33:33.408 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T06:33:33.417 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T06:33:33.423 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T06:33:33.423 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-09-16T06:33:33.425 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-16T06:33:33.431 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T06:33:33.437 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T06:33:33.437 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-09-16T06:33:33.471 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-16T06:33:33.496 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T06:33:33.551 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T06:33:33.564 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T06:33:33.564 INFO:teuthology.task.kernel:config {'mgr.x': {'kdb': 1, 'sha1': 'distro'}, 'mgr.y': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T06:33:33.565 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T06:33:33.565 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T06:33:33.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:33:33.570 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-16T06:33:33.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:33:33.571 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-16T06:33:33.618 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-56-generic 2024-09-16T06:33:33.618 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.15.0-56-generic 2024-09-16T06:33:33.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-16T06:33:33.620 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2024-09-16T06:33:33.620 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.15.0-56-generic 2024-09-16T06:33:33.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-09-16T06:33:33.736 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-16T06:33:33.752 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-16T06:33:33.921 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T06:33:33.921 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T06:33:33.921 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T06:33:33.997 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T06:33:34.036 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T06:33:34.036 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T06:33:34.080 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T06:33:34.147 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T06:33:34.218 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T06:33:34.247 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T06:33:34.251 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T06:33:34.253 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T06:33:34.253 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T06:33:34.254 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T06:33:34.273 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T06:33:34.276 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T06:33:34.276 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T06:33:34.280 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T06:33:34.291 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T06:33:34.297 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T06:33:34.297 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T06:33:34.298 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T06:33:34.298 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T06:33:34.304 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T06:33:34.309 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T06:33:34.317 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T06:33:34.321 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T06:33:34.321 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T06:33:34.322 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T06:33:34.347 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T06:33:34.350 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T06:33:34.350 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T06:33:34.355 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T06:33:34.362 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T06:33:34.363 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T06:33:34.364 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T06:33:34.364 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T06:33:34.365 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T06:33:34.372 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T06:33:34.372 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T06:33:34.372 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T06:33:34.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T06:33:34.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T06:33:34.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T06:33:34.383 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T06:33:34.383 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T06:33:34.391 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T06:33:34.436 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T06:33:34.460 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T06:33:34.575 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T06:33:34.804 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-16T06:33:34.887 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T06:33:34.904 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T06:33:34.912 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T06:33:34.913 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T06:33:34.914 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T06:33:34.929 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-16T06:33:34.944 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T06:33:34.944 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T06:33:34.945 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-16T06:33:35.011 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T06:33:35.069 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-16T06:33:35.069 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T06:33:35.070 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T06:33:35.075 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T06:33:35.075 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T06:33:35.084 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T06:33:35.085 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T06:33:35.096 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T06:33:35.098 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T06:33:35.099 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T06:33:35.099 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T06:33:35.101 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T06:33:35.101 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T06:33:35.102 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T06:33:35.102 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T06:33:35.103 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T06:33:35.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T06:33:35.155 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T06:33:35.174 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T06:33:35.174 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T06:33:35.175 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T06:33:35.176 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T06:33:35.256 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T06:33:35.256 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T06:33:35.257 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T06:33:35.257 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T06:33:35.258 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T06:33:40.692 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 16.0 MB in 2s (7,461 kB/s) 2024-09-16T06:33:41.146 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 16.0 MB in 3s (5,725 kB/s) 2024-09-16T06:33:42.106 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-16T06:33:42.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T06:33:42.189 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-16T06:33:42.399 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-16T06:33:42.400 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-16T06:33:42.499 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T06:33:42.516 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T06:33:42.581 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T06:33:42.590 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T06:33:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T06:33:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T06:33:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T06:33:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T06:33:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-09-16T06:33:42.591 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T06:33:42.592 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-16T06:33:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T06:33:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T06:33:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T06:33:42.594 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-16T06:33:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T06:33:42.594 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-09-16T06:33:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2024-09-16T06:33:42.637 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-16T06:33:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T06:33:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T06:33:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T06:33:42.638 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-09-16T06:33:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T06:33:42.689 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T06:33:42.689 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 113 MB of archives. 2024-09-16T06:33:42.689 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T06:33:42.689 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T06:33:42.792 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-16T06:33:42.792 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-16T06:33:42.982 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T06:33:42.982 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T06:33:42.982 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T06:33:42.983 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T06:33:42.983 INFO:teuthology.orchestra.run.smithi096.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T06:33:42.983 INFO:teuthology.orchestra.run.smithi096.stdout: python2.7-minimal 2024-09-16T06:33:42.983 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T06:33:42.984 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-16T06:33:42.984 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T06:33:42.984 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T06:33:42.985 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T06:33:42.986 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-16T06:33:42.986 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T06:33:42.986 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-16T06:33:42.986 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-09-16T06:33:43.035 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-16T06:33:43.036 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T06:33:43.036 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T06:33:43.036 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T06:33:43.037 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-09-16T06:33:43.041 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T06:33:43.130 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T06:33:43.218 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T06:33:43.219 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 113 MB of archives. 2024-09-16T06:33:43.219 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T06:33:43.219 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T06:33:43.242 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T06:33:44.052 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T06:33:44.107 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T06:33:44.108 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T06:33:44.254 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T06:33:44.276 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T06:33:44.604 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T06:33:44.755 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 113 MB in 2s (66.0 MB/s) 2024-09-16T06:33:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T06:33:44.958 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T06:33:46.845 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T06:33:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:33:46.914 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:33:47.171 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T06:33:47.171 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T06:33:47.172 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T06:33:47.520 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T06:33:47.601 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T06:33:47.985 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-16T06:33:48.157 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T06:33:49.056 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T06:33:49.078 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:33:49.170 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:33:49.609 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T06:33:49.630 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:33:49.659 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:33:50.129 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T06:33:50.133 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:33:50.210 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:33:52.346 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T06:33:52.368 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:33:52.466 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:33:52.907 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T06:33:52.928 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:33:52.965 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:33:56.332 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T06:33:56.459 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T06:33:56.800 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T06:33:56.921 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T06:33:57.190 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T06:33:57.201 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T06:33:57.231 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T06:34:00.067 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T06:34:00.179 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T06:34:00.536 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T06:34:00.658 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T06:34:00.961 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T06:34:00.972 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T06:34:01.011 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T06:34:02.447 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T06:34:02.485 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:34:02.521 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:05.076 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T06:34:05.210 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T06:34:05.543 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T06:34:05.647 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:05.774 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T06:34:05.901 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:06.562 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T06:34:06.600 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T06:34:06.637 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:07.214 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T06:34:07.214 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T06:34:07.214 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T06:34:07.215 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:07.372 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:08.748 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:10.781 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T06:34:10.825 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T06:34:10.964 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T06:34:11.300 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T06:34:11.314 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T06:34:11.426 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:11.435 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T06:34:11.486 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:11.536 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T06:34:11.639 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:12.976 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T06:34:12.976 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T06:34:12.976 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T06:34:12.977 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:13.142 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:14.543 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:16.353 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T06:34:16.470 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T06:34:16.580 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T06:34:16.630 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T06:34:16.630 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:26.013 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T06:34:26.013 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2024-09-16T06:34:26.019 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T06:34:26.040 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2024-09-16T06:34:26.401 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T06:34:26.421 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:26.798 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T06:34:26.803 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T06:34:26.875 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T06:34:26.880 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T06:34:27.035 INFO:teuthology.orchestra.run.smithi134.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T06:34:27.035 INFO:teuthology.orchestra.run.smithi134.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T06:34:27.035 INFO:teuthology.orchestra.run.smithi134.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T06:34:27.080 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-09-16T06:34:27.573 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-09-16T06:34:27.601 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-09-16T06:34:27.601 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-09-16T06:34:27.601 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-09-16T06:34:27.601 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-09-16T06:34:27.602 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-09-16T06:34:27.602 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T06:34:27.602 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-09-16T06:34:27.602 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-09-16T06:34:27.602 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.121.121 2024-09-16T06:34:27.602 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T06:34:27.602 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T06:34:27.603 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-09-16T06:34:27.603 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-09-16T06:34:27.603 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-09-16T06:34:27.603 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-09-16T06:34:27.603 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T06:34:27.604 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T06:34:27.604 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T06:34:27.604 INFO:teuthology.task.kernel:Installing distro kernel on mgr.y... 2024-09-16T06:34:27.604 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T06:34:27.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-09-16T06:34:27.791 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-16T06:34:27.913 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T06:34:27.921 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T06:34:27.939 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T06:34:28.033 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T06:34:29.353 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-16T06:34:29.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T06:34:29.423 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-16T06:34:29.612 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-16T06:34:29.612 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-16T06:34:29.787 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T06:34:29.787 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T06:34:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T06:34:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T06:34:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T06:34:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T06:34:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T06:34:29.788 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T06:34:29.829 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T06:34:29.831 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-09-16T06:34:29.894 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-09-16T06:34:29.894 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-09-16T06:34:29.894 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-09-16T06:34:29.894 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-09-16T06:34:29.894 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-09-16T06:34:29.894 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T06:34:29.894 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.121.121 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-09-16T06:34:29.895 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-09-16T06:34:29.895 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-16T06:34:29.939 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.F7azEuQzn4 2024-09-16T06:34:29.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.F7azEuQzn4 2024-09-16T06:34:29.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.F7azEuQzn4 2024-09-16T06:34:30.122 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.F7azEuQzn4 is 10KB 2024-09-16T06:34:30.135 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.F7azEuQzn4 2024-09-16T06:34:30.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T06:34:30.195 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:34:30.196 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T06:34:30.196 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T06:34:30.262 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T06:34:30.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2024-09-16T06:34:30.490 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T06:34:30.490 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-09-16T06:34:30.525 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T06:34:30.552 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-09-16T06:34:30.814 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T06:34:30.839 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:31.224 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T06:34:31.230 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T06:34:31.293 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T06:34:31.298 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T06:34:31.438 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-09-16T06:34:31.439 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T06:34:31.442 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-16T06:34:31.449 INFO:teuthology.orchestra.run.smithi096.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T06:34:31.449 INFO:teuthology.orchestra.run.smithi096.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T06:34:31.449 INFO:teuthology.orchestra.run.smithi096.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T06:34:31.491 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-09-16T06:34:31.700 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T06:34:31.707 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:31.949 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-16T06:34:31.970 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-16T06:34:31.970 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-16T06:34:31.970 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-16T06:34:31.970 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-16T06:34:31.970 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.121.121 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-16T06:34:31.971 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-16T06:34:31.972 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T06:34:31.972 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T06:34:31.973 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T06:34:31.973 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T06:34:31.973 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T06:34:31.973 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-09-16T06:34:32.009 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T06:34:32.014 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T06:34:32.057 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T06:34:32.062 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T06:34:32.121 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-16T06:34:32.193 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T06:34:32.193 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T06:34:32.193 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T06:34:32.211 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-16T06:34:32.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-16T06:34:32.243 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T06:34:32.249 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T06:34:32.267 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T06:34:32.363 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T06:34:33.680 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T06:34:33.699 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T06:34:33.766 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T06:34:33.992 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-16T06:34:33.993 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-16T06:34:34.188 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T06:34:34.188 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T06:34:34.188 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T06:34:34.188 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T06:34:34.188 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T06:34:34.189 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T06:34:34.189 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T06:34:34.189 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T06:34:34.230 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T06:34:34.232 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-09-16T06:34:34.248 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-09-16T06:34:34.248 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-09-16T06:34:34.248 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 21 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.15.0.121.121 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-09-16T06:34:34.249 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-09-16T06:34:34.250 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-16T06:34:34.296 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.hngh3qsflq 2024-09-16T06:34:34.296 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hngh3qsflq 2024-09-16T06:34:34.353 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.hngh3qsflq 2024-09-16T06:34:34.476 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.hngh3qsflq is 10KB 2024-09-16T06:34:34.489 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.hngh3qsflq 2024-09-16T06:34:34.495 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T06:34:34.547 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:34:34.548 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T06:34:34.548 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T06:34:34.611 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T06:34:34.611 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-09-16T06:34:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-09-16T06:34:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T06:34:35.872 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-09-16T06:34:36.025 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T06:34:36.030 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T06:34:36.268 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T06:34:36.274 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T06:34:36.315 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T06:34:36.321 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T06:34:36.474 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T06:34:36.474 INFO:teuthology.orchestra.run.smithi096.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T06:34:36.474 INFO:teuthology.orchestra.run.smithi096.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T06:34:36.497 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-09-16T06:34:36.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-09-16T06:35:02.249 INFO:teuthology.task.kernel:Checking client mgr.y for new kernel version... 2024-09-16T06:35:02.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T06:35:02.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:35:06.509 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T06:35:06.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T06:35:06.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:35:20.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-16T06:35:24.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-16T06:35:29.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T06:35:29.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:35:32.833 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-16T06:35:33.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T06:35:33.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:35:36.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-16T06:35:44.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T06:35:44.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:35:48.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T06:35:48.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:36:03.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-16T06:36:07.357 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-09-16T06:36:18.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T06:36:18.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:36:18.633 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-16T06:36:19.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T06:36:19.753 INFO:teuthology.task.kernel:Checking kernel version of mgr.y, want "5.15.0-121-generic"... 2024-09-16T06:36:19.754 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-16T06:36:19.801 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-121-generic 2024-09-16T06:36:19.802 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T06:36:19.802 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T06:36:19.802 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T06:36:20.803 INFO:teuthology.task.kernel:Enabling kdb on mgr.y... 2024-09-16T06:36:20.803 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T06:36:21.016 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-16T06:36:21.072 DEBUG:teuthology.parallel:result is None 2024-09-16T06:36:22.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T06:36:22.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:36:22.738 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-16T06:36:23.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T06:36:23.527 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-121-generic"... 2024-09-16T06:36:23.527 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-09-16T06:36:23.574 INFO:teuthology.orchestra.run.smithi096.stdout:5.15.0-121-generic 2024-09-16T06:36:23.574 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T06:36:23.574 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T06:36:23.574 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T06:36:24.576 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T06:36:24.576 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T06:36:24.667 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-09-16T06:36:24.687 DEBUG:teuthology.parallel:result is None 2024-09-16T06:36:24.688 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T06:36:24.699 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T06:36:24.699 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T06:36:24.702 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T06:36:24.708 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T06:36:24.714 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T06:36:24.728 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T06:36:24.729 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T06:36:24.751 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T06:36:24.845 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T06:36:24.851 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T06:36:24.851 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T06:36:24.854 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T06:36:24.872 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T06:36:24.879 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T06:36:24.879 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T06:36:24.887 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T06:36:24.888 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T06:36:24.896 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T06:36:24.896 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T06:36:24.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T06:36:24.948 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T06:36:24.961 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T06:36:24.961 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T06:36:24.991 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T06:36:24.996 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T06:36:25.041 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T06:36:25.089 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:36:25.089 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T06:36:25.149 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T06:36:25.155 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T06:36:25.203 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:36:25.203 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T06:36:25.262 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-09-16T06:36:25.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-16T06:36:25.337 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T06:36:25.346 INFO:teuthology.task.internal:Starting timer... 2024-09-16T06:36:25.346 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T06:36:25.356 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T06:36:25.364 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-09-16T06:36:25.364 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-09-16T06:36:25.365 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T06:36:25.365 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T06:36:25.365 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T06:36:25.365 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T06:36:25.373 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T06:36:25.386 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T06:36:25.387 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T06:43:57.774 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-09-16T06:43:57.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T06:43:57.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:43:57.866 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-09-16T06:43:57.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-09-16T06:43:57.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T06:43:57.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T06:43:58.026 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-16T06:43:58.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T06:43:58.105 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T06:43:58.115 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T06:43:58.115 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T06:43:58.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T06:43:58.118 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T06:43:58.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Command line: ntpd -gq 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: ---------------------------------------------------- 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: corporation. Support and training for ntp-4 are 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: available at https://www.nwtime.org/support 2024-09-16T06:43:58.144 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: ---------------------------------------------------- 2024-09-16T06:43:58.145 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: proto: precision = 0.060 usec (-24) 2024-09-16T06:43:58.145 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: basedate set to 2022-02-04 2024-09-16T06:43:58.145 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: gps base set to 2022-02-06 (week 2196) 2024-09-16T06:43:58.145 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T06:43:58.146 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T06:43:58.146 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T06:43:58.146 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T06:43:58.147 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T06:43:58.147 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T06:43:58.147 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T06:43:58.147 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-09-16T06:43:58.147 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Listen normally on 4 lo [::1]:123 2024-09-16T06:43:58.147 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-09-16T06:43:58.147 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:43:58 ntpd[18464]: Listening on routing socket on fd #22 for interface updates 2024-09-16T06:43:58.171 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T06:43:58.171 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Command line: ntpd -gq 2024-09-16T06:43:58.171 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: ---------------------------------------------------- 2024-09-16T06:43:58.171 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T06:43:58.171 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T06:43:58.172 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: corporation. Support and training for ntp-4 are 2024-09-16T06:43:58.172 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: available at https://www.nwtime.org/support 2024-09-16T06:43:58.172 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: ---------------------------------------------------- 2024-09-16T06:43:58.172 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: proto: precision = 0.045 usec (-24) 2024-09-16T06:43:58.172 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: basedate set to 2022-02-04 2024-09-16T06:43:58.173 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: gps base set to 2022-02-06 (week 2196) 2024-09-16T06:43:58.173 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T06:43:58.173 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T06:43:58.173 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T06:43:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T06:43:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T06:43:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T06:43:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T06:43:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-09-16T06:43:58.174 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Listen normally on 4 lo [::1]:123 2024-09-16T06:43:58.175 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-09-16T06:43:58.175 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:43:58 ntpd[18457]: Listening on routing socket on fd #22 for interface updates 2024-09-16T06:43:59.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:43:59.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:43:59.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:43:59.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:43:59.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:43:59.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:43:59.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:43:59.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:43:59 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:43:59.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:43:59.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:43:59.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:43:59.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:43:59.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:43:59.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:43:59.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:43:59.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:43:59 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:00 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:00 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:00 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:00 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:00 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:00 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:00.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:00 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:00.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:00 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:00.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:00 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:00.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:00 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:00.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:00 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:00.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:00 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:01.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:01.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:01 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:01.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:01.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:01 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:02 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:02 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:02 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:02 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:02 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:02.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:02 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:02.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:02 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:02.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:02 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:02.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:02 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:02.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:02 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:02.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:02 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:02.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:02 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:03.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:03.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:03 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:03.176 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:03.177 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:03 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:04.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:04 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:04.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:04 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:04.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:04 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:04.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:04 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:04.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:04 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:04.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:04 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:04 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:04 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:04 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:04.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:04 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:05.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:05.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:05.145 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stdout:16 Sep 06:44:05 ntpd[18464]: ntpd: time slew -0.001965 s 2024-09-16T06:44:05.146 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.001965s 2024-09-16T06:44:05.147 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T06:44:05.147 INFO:teuthology.orchestra.run.smithi096.stderr:16 Sep 06:44:05 ntpd[18464]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T06:44:05.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:05.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:05.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:05.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:05.172 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T06:44:05.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T06:44:05.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T06:44:05.173 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T06:44:05.173 INFO:teuthology.orchestra.run.smithi134.stdout:16 Sep 06:44:05 ntpd[18457]: ntpd: time slew +0.000187 s 2024-09-16T06:44:05.173 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew +0.000187s 2024-09-16T06:44:05.174 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T06:44:05.174 INFO:teuthology.orchestra.run.smithi134.stderr:16 Sep 06:44:05 ntpd[18457]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T06:44:05.195 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T06:44:05.195 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-16T06:44:05.195 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.195 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.195 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.195 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T06:44:05.297 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-16T06:44:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.297 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.298 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:44:05.299 INFO:teuthology.run_tasks:Running task install... 2024-09-16T06:44:05.307 DEBUG:teuthology.task.install:project ceph 2024-09-16T06:44:05.307 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}} 2024-09-16T06:44:05.308 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'} 2024-09-16T06:44:05.308 INFO:teuthology.task.install:Using flavor: default 2024-09-16T06:44:05.313 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T06:44:05.313 INFO:teuthology.task.install:extra packages: [] 2024-09-16T06:44:05.314 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-09-16T06:44:05.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-09-16T06:44:05.375 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T06:44:05.404 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T06:44:05.404 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T06:44:05.405 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T06:44:05.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T06:44:05.409 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T06:44:05.440 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T06:44:05.440 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T06:44:05.440 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T06:44:05.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T06:44:05.549 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default/ 2024-09-16T06:44:05.549 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:44:05.590 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default/ 2024-09-16T06:44:05.590 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:44:05.659 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:44:05.660 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T06:44:05.673 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-09-16T06:44:05.700 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:44:05.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T06:44:05.715 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-16T06:44:05.842 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T06:44:05.852 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T06:44:05.869 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T06:44:05.896 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T06:44:05.917 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T06:44:05.939 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T06:44:05.940 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T06:44:05.960 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-09-16T06:44:05.961 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T06:44:05.966 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T06:44:05.984 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T06:44:05.987 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-09-16T06:44:06.005 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-09-16T06:44:06.022 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T06:44:06.022 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T06:44:06.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-09-16T06:44:06.089 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T06:44:06.423 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 158 kB in 1s (282 kB/s) 2024-09-16T06:44:06.442 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T06:44:06.615 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 286 kB in 1s (401 kB/s) 2024-09-16T06:44:07.450 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T06:44:07.467 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1jammy cephadm=18.2.4-845-ge4e227b3-1jammy ceph-mds=18.2.4-845-ge4e227b3-1jammy ceph-mgr=18.2.4-845-ge4e227b3-1jammy ceph-common=18.2.4-845-ge4e227b3-1jammy ceph-fuse=18.2.4-845-ge4e227b3-1jammy ceph-test=18.2.4-845-ge4e227b3-1jammy ceph-volume=18.2.4-845-ge4e227b3-1jammy radosgw=18.2.4-845-ge4e227b3-1jammy python3-rados=18.2.4-845-ge4e227b3-1jammy python3-rgw=18.2.4-845-ge4e227b3-1jammy python3-cephfs=18.2.4-845-ge4e227b3-1jammy python3-rbd=18.2.4-845-ge4e227b3-1jammy libcephfs2=18.2.4-845-ge4e227b3-1jammy libcephfs-dev=18.2.4-845-ge4e227b3-1jammy librados2=18.2.4-845-ge4e227b3-1jammy librbd1=18.2.4-845-ge4e227b3-1jammy rbd-fuse=18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:44:07.529 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-09-16T06:44:07.630 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-16T06:44:07.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1jammy cephadm=18.2.4-845-ge4e227b3-1jammy ceph-mds=18.2.4-845-ge4e227b3-1jammy ceph-mgr=18.2.4-845-ge4e227b3-1jammy ceph-common=18.2.4-845-ge4e227b3-1jammy ceph-fuse=18.2.4-845-ge4e227b3-1jammy ceph-test=18.2.4-845-ge4e227b3-1jammy ceph-volume=18.2.4-845-ge4e227b3-1jammy radosgw=18.2.4-845-ge4e227b3-1jammy python3-rados=18.2.4-845-ge4e227b3-1jammy python3-rgw=18.2.4-845-ge4e227b3-1jammy python3-cephfs=18.2.4-845-ge4e227b3-1jammy python3-rbd=18.2.4-845-ge4e227b3-1jammy libcephfs2=18.2.4-845-ge4e227b3-1jammy libcephfs-dev=18.2.4-845-ge4e227b3-1jammy librados2=18.2.4-845-ge4e227b3-1jammy librbd1=18.2.4-845-ge4e227b3-1jammy rbd-fuse=18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:44:07.710 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-16T06:44:07.739 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-09-16T06:44:07.740 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-09-16T06:44:07.918 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-16T06:44:07.919 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-16T06:44:07.934 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T06:44:07.934 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T06:44:07.934 INFO:teuthology.orchestra.run.smithi096.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T06:44:07.935 INFO:teuthology.orchestra.run.smithi096.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T06:44:07.935 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T06:44:07.935 INFO:teuthology.orchestra.run.smithi096.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T06:44:07.935 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T06:44:07.936 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-09-16T06:44:07.936 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T06:44:07.936 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T06:44:07.936 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-16T06:44:07.936 INFO:teuthology.orchestra.run.smithi096.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T06:44:07.937 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-16T06:44:07.938 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: python3-watchdog 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-09-16T06:44:07.939 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-09-16T06:44:08.040 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-09-16T06:44:08.040 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T06:44:08.040 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T06:44:08.040 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-16T06:44:08.042 INFO:teuthology.orchestra.run.smithi096.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-16T06:44:08.043 INFO:teuthology.orchestra.run.smithi096.stdout: socat xmlstarlet 2024-09-16T06:44:08.113 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T06:44:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T06:44:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T06:44:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T06:44:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T06:44:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T06:44:08.114 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T06:44:08.114 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-16T06:44:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T06:44:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T06:44:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-16T06:44:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T06:44:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-16T06:44:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T06:44:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T06:44:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T06:44:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T06:44:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: python3-watchdog 2024-09-16T06:44:08.117 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-09-16T06:44:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-09-16T06:44:08.216 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-16T06:44:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T06:44:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T06:44:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T06:44:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-16T06:44:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-16T06:44:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-16T06:44:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-16T06:44:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T06:44:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T06:44:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-16T06:44:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-16T06:44:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T06:44:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-16T06:44:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: socat xmlstarlet 2024-09-16T06:44:08.230 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T06:44:08.230 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 163 MB of archives. 2024-09-16T06:44:08.230 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-16T06:44:08.230 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-16T06:44:08.358 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1jammy [3,451 kB] 2024-09-16T06:44:08.405 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T06:44:08.406 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 163 MB of archives. 2024-09-16T06:44:08.406 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-16T06:44:08.406 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-16T06:44:08.507 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1jammy [3,451 kB] 2024-09-16T06:44:08.508 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T06:44:08.681 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T06:44:08.687 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T06:44:08.695 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T06:44:08.704 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1jammy [3,108 kB] 2024-09-16T06:44:08.768 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T06:44:08.845 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1jammy [683 kB] 2024-09-16T06:44:08.859 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1jammy [357 kB] 2024-09-16T06:44:08.860 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T06:44:08.865 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1jammy [32.8 kB] 2024-09-16T06:44:08.865 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1jammy [180 kB] 2024-09-16T06:44:08.869 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1jammy [63.7 kB] 2024-09-16T06:44:08.870 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1jammy [333 kB] 2024-09-16T06:44:08.874 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T06:44:08.876 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1jammy [5,934 kB] 2024-09-16T06:44:08.947 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T06:44:08.962 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T06:44:08.972 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T06:44:09.000 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T06:44:09.008 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T06:44:09.008 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T06:44:09.010 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T06:44:09.028 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T06:44:09.031 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T06:44:09.031 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T06:44:09.044 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T06:44:09.095 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1jammy [112 kB] 2024-09-16T06:44:09.097 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1jammy [445 kB] 2024-09-16T06:44:09.116 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T06:44:09.116 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T06:44:09.116 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T06:44:09.117 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T06:44:09.117 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T06:44:09.118 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T06:44:09.123 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T06:44:09.126 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T06:44:09.127 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T06:44:09.141 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T06:44:09.142 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1jammy [22.0 MB] 2024-09-16T06:44:09.152 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T06:44:09.179 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T06:44:09.187 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T06:44:09.188 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T06:44:09.189 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T06:44:09.207 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T06:44:09.207 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T06:44:09.209 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T06:44:09.209 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T06:44:09.210 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T06:44:09.210 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T06:44:09.210 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T06:44:09.213 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T06:44:09.214 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T06:44:09.215 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T06:44:09.223 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T06:44:09.289 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T06:44:09.289 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T06:44:09.290 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T06:44:09.293 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T06:44:09.294 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T06:44:09.295 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T06:44:09.296 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T06:44:09.296 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T06:44:09.297 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T06:44:09.302 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T06:44:09.305 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T06:44:09.306 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T06:44:09.337 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1jammy [3,108 kB] 2024-09-16T06:44:09.370 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T06:44:09.372 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T06:44:09.377 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T06:44:09.378 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T06:44:09.381 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T06:44:09.382 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T06:44:09.385 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T06:44:09.387 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T06:44:09.387 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T06:44:09.388 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T06:44:09.389 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T06:44:09.391 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T06:44:09.393 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T06:44:09.393 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T06:44:09.451 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T06:44:09.453 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T06:44:09.458 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T06:44:09.467 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T06:44:09.467 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T06:44:09.468 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T06:44:09.549 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T06:44:09.551 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T06:44:09.555 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T06:44:09.556 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T06:44:09.559 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T06:44:09.560 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T06:44:09.565 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T06:44:09.618 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T06:44:09.620 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T06:44:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T06:44:09.622 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T06:44:09.624 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T06:44:09.624 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T06:44:09.625 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T06:44:09.629 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T06:44:09.629 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T06:44:09.630 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T06:44:09.631 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T06:44:09.636 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T06:44:09.703 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T06:44:09.743 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T06:44:09.747 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T06:44:09.747 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T06:44:09.798 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T06:44:09.800 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T06:44:09.802 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T06:44:09.803 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T06:44:09.803 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T06:44:09.804 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T06:44:09.805 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T06:44:09.805 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T06:44:09.805 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T06:44:09.806 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T06:44:09.806 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T06:44:09.806 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T06:44:09.807 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T06:44:09.810 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T06:44:09.810 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T06:44:09.845 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1jammy [683 kB] 2024-09-16T06:44:09.866 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T06:44:09.867 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T06:44:09.873 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T06:44:09.883 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T06:44:09.926 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T06:44:09.930 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T06:44:09.931 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T06:44:09.947 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T06:44:09.950 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T06:44:09.952 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T06:44:09.959 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1jammy [357 kB] 2024-09-16T06:44:09.960 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T06:44:09.965 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T06:44:09.975 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T06:44:09.982 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T06:44:09.983 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T06:44:09.984 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T06:44:09.985 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T06:44:09.986 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T06:44:09.986 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T06:44:09.987 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T06:44:10.008 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1jammy [32.8 kB] 2024-09-16T06:44:10.008 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1jammy [180 kB] 2024-09-16T06:44:10.011 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1jammy [63.7 kB] 2024-09-16T06:44:10.029 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T06:44:10.032 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T06:44:10.046 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T06:44:10.047 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T06:44:10.048 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T06:44:10.054 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T06:44:10.065 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1jammy [333 kB] 2024-09-16T06:44:10.072 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1jammy [5,934 kB] 2024-09-16T06:44:10.110 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T06:44:10.128 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T06:44:10.131 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T06:44:10.132 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T06:44:10.141 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T06:44:10.147 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T06:44:10.148 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T06:44:10.150 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1jammy [5,005 kB] 2024-09-16T06:44:10.158 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T06:44:10.165 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T06:44:10.209 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T06:44:10.213 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T06:44:10.229 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T06:44:10.290 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T06:44:10.292 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T06:44:10.316 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1jammy [241 kB] 2024-09-16T06:44:10.321 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1jammy [130 kB] 2024-09-16T06:44:10.333 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1jammy [1,494 kB] 2024-09-16T06:44:10.397 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1jammy [6,085 kB] 2024-09-16T06:44:10.681 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1jammy [22.4 MB] 2024-09-16T06:44:10.973 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1jammy [112 kB] 2024-09-16T06:44:11.028 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1jammy [445 kB] 2024-09-16T06:44:11.093 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1jammy [22.0 MB] 2024-09-16T06:44:11.799 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1jammy [14.1 kB] 2024-09-16T06:44:11.800 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1jammy [834 kB] 2024-09-16T06:44:11.816 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1jammy [2,159 kB] 2024-09-16T06:44:11.854 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1jammy [240 kB] 2024-09-16T06:44:11.858 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1jammy [145 kB] 2024-09-16T06:44:11.860 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1jammy [2,233 kB] 2024-09-16T06:44:11.975 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1jammy [8,625 kB] 2024-09-16T06:44:12.382 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1jammy [14.3 kB] 2024-09-16T06:44:12.382 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1jammy [42.8 MB] 2024-09-16T06:44:14.037 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1jammy [5,005 kB] 2024-09-16T06:44:14.244 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1jammy [122 kB] 2024-09-16T06:44:14.247 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1jammy [38.3 kB] 2024-09-16T06:44:14.248 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1jammy [11.7 MB] 2024-09-16T06:44:14.294 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1jammy [241 kB] 2024-09-16T06:44:14.331 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1jammy [130 kB] 2024-09-16T06:44:14.335 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1jammy [1,494 kB] 2024-09-16T06:44:14.480 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1jammy [6,085 kB] 2024-09-16T06:44:14.524 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1jammy [93.1 kB] 2024-09-16T06:44:14.789 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1jammy [22.4 MB] 2024-09-16T06:44:15.096 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 163 MB in 6s (25.1 MB/s) 2024-09-16T06:44:15.264 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-16T06:44:15.364 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T06:44:15.370 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-16T06:44:15.471 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T06:44:15.882 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T06:44:15.908 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T06:44:15.923 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1jammy [14.1 kB] 2024-09-16T06:44:15.924 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1jammy [834 kB] 2024-09-16T06:44:15.939 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1jammy [2,159 kB] 2024-09-16T06:44:15.957 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T06:44:16.017 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1jammy [240 kB] 2024-09-16T06:44:16.034 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1jammy [145 kB] 2024-09-16T06:44:16.039 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1jammy [2,233 kB] 2024-09-16T06:44:16.134 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1jammy [8,625 kB] 2024-09-16T06:44:16.336 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T06:44:16.362 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T06:44:16.402 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T06:44:16.490 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1jammy [14.3 kB] 2024-09-16T06:44:16.491 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1jammy [42.8 MB] 2024-09-16T06:44:16.797 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T06:44:16.823 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T06:44:16.872 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T06:44:17.409 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T06:44:17.436 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T06:44:17.484 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:44:17.895 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T06:44:17.922 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T06:44:17.962 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:44:18.306 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T06:44:18.333 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T06:44:18.373 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:44:18.425 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1jammy [122 kB] 2024-09-16T06:44:18.427 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1jammy [38.3 kB] 2024-09-16T06:44:18.428 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1jammy [11.7 MB] 2024-09-16T06:44:18.684 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T06:44:18.710 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T06:44:18.742 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T06:44:18.819 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1jammy [93.1 kB] 2024-09-16T06:44:19.062 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librados2. 2024-09-16T06:44:19.088 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:19.128 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:19.394 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 163 MB in 11s (15.4 MB/s) 2024-09-16T06:44:19.541 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-16T06:44:19.638 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T06:44:19.643 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-16T06:44:19.740 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T06:44:19.806 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librbd1. 2024-09-16T06:44:19.832 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-librbd1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:19.873 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:20.085 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T06:44:20.111 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T06:44:20.151 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T06:44:20.292 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T06:44:20.318 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:20.358 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:20.505 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T06:44:20.531 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T06:44:20.571 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T06:44:20.603 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-09-16T06:44:20.618 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python3-rados_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:20.653 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:20.883 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T06:44:20.909 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T06:44:20.941 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T06:44:20.972 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T06:44:20.998 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:21.038 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:21.274 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T06:44:21.290 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:21.341 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:21.419 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T06:44:21.446 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T06:44:21.494 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:44:21.652 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T06:44:21.679 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:21.727 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:21.905 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T06:44:21.932 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T06:44:21.972 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:44:22.046 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T06:44:22.073 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T06:44:22.113 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T06:44:22.275 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T06:44:22.302 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T06:44:22.342 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:44:22.433 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T06:44:22.459 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T06:44:22.499 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T06:44:22.703 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T06:44:22.729 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T06:44:22.760 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T06:44:22.769 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T06:44:22.775 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:22.810 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:23.081 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-09-16T06:44:23.087 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T06:44:23.103 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T06:44:23.107 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:23.137 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T06:44:23.147 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:23.465 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-09-16T06:44:23.491 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:23.531 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:23.575 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-09-16T06:44:23.590 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-librbd1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:23.625 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:24.027 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T06:44:24.042 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T06:44:24.054 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:24.068 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:24.094 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:24.109 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:24.388 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-09-16T06:44:24.403 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T06:44:24.415 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-python3-rados_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:24.430 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T06:44:24.455 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:24.462 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T06:44:24.773 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T06:44:24.791 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T06:44:24.799 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:24.817 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:24.839 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:24.857 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:25.168 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T06:44:25.195 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:25.243 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:25.426 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-09-16T06:44:25.452 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:25.493 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:25.621 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T06:44:25.648 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:26.041 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T06:44:26.067 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T06:44:26.107 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T06:44:26.435 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T06:44:26.462 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T06:44:26.502 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T06:44:26.757 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-09-16T06:44:26.779 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T06:44:26.783 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:26.806 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:26.824 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:26.854 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:27.274 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T06:44:27.301 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T06:44:27.349 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T06:44:27.430 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T06:44:27.456 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T06:44:27.496 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T06:44:27.685 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-09-16T06:44:27.712 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:27.751 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:27.799 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T06:44:27.825 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T06:44:27.865 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T06:44:28.202 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T06:44:28.228 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T06:44:28.262 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T06:44:28.268 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T06:44:28.278 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:28.320 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:28.621 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T06:44:28.647 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T06:44:28.696 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T06:44:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T06:44:28.742 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T06:44:28.790 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T06:44:29.015 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T06:44:29.042 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T06:44:29.082 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T06:44:29.176 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T06:44:29.202 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:29.243 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:29.376 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T06:44:29.402 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T06:44:29.443 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T06:44:29.671 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-09-16T06:44:29.698 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:29.737 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:29.804 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-portend. 2024-09-16T06:44:29.830 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-16T06:44:29.871 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T06:44:30.324 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T06:44:30.350 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T06:44:30.390 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T06:44:30.684 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T06:44:30.711 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T06:44:30.742 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T06:44:31.046 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T06:44:31.073 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T06:44:31.104 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T06:44:31.110 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-09-16T06:44:31.136 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:31.195 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:31.407 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T06:44:31.434 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T06:44:31.474 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T06:44:31.776 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T06:44:31.803 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T06:44:31.843 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T06:44:32.014 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T06:44:32.041 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T06:44:32.080 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T06:44:32.154 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-09-16T06:44:32.181 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T06:44:32.221 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T06:44:32.350 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T06:44:32.377 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T06:44:32.408 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T06:44:32.507 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T06:44:32.534 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T06:44:32.574 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T06:44:32.678 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T06:44:32.693 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T06:44:32.728 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T06:44:32.843 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T06:44:32.869 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T06:44:32.910 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T06:44:33.055 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T06:44:33.084 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T06:44:33.122 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T06:44:33.221 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-09-16T06:44:33.247 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T06:44:33.288 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T06:44:33.450 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T06:44:33.477 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T06:44:33.517 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T06:44:33.657 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T06:44:33.683 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T06:44:33.727 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T06:44:33.786 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T06:44:33.812 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T06:44:33.844 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T06:44:34.043 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T06:44:34.069 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T06:44:34.109 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T06:44:34.114 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-09-16T06:44:34.140 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-16T06:44:34.180 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T06:44:34.387 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-09-16T06:44:34.414 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T06:44:34.445 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T06:44:34.483 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T06:44:34.510 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T06:44:34.550 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T06:44:34.782 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T06:44:34.797 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T06:44:34.840 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T06:44:34.853 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T06:44:34.879 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T06:44:34.920 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T06:44:35.158 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T06:44:35.185 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T06:44:35.264 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T06:44:35.267 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T06:44:35.290 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T06:44:35.331 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T06:44:35.546 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T06:44:35.572 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T06:44:35.612 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T06:44:35.634 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T06:44:35.660 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T06:44:35.701 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T06:44:35.924 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T06:44:35.950 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T06:44:35.961 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T06:44:35.976 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T06:44:35.990 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T06:44:36.011 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T06:44:36.298 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-09-16T06:44:36.324 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T06:44:36.345 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T06:44:36.364 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T06:44:36.371 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T06:44:36.411 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T06:44:36.714 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-idna. 2024-09-16T06:44:36.729 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T06:44:36.734 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T06:44:36.761 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T06:44:36.764 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T06:44:36.801 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T06:44:37.053 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T06:44:37.067 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T06:44:37.079 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T06:44:37.094 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T06:44:37.111 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T06:44:37.133 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T06:44:37.414 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-09-16T06:44:37.428 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests. 2024-09-16T06:44:37.440 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T06:44:37.455 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T06:44:37.481 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T06:44:37.494 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T06:44:37.823 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T06:44:37.825 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T06:44:37.849 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T06:44:37.852 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T06:44:37.889 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T06:44:37.895 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T06:44:38.184 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T06:44:38.195 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T06:44:38.210 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:38.221 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T06:44:38.250 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:38.261 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T06:44:38.564 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-09-16T06:44:38.591 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T06:44:38.622 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T06:44:38.647 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T06:44:38.673 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:38.713 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:38.909 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T06:44:38.936 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T06:44:38.967 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T06:44:39.033 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T06:44:39.059 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T06:44:39.099 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T06:44:39.295 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T06:44:39.321 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T06:44:39.361 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T06:44:39.393 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T06:44:39.420 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T06:44:39.460 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T06:44:39.664 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T06:44:39.691 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T06:44:39.731 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T06:44:39.796 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T06:44:39.825 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:39.863 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:40.043 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T06:44:40.069 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T06:44:40.109 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T06:44:40.207 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T06:44:40.234 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:40.415 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:40.472 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T06:44:40.499 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T06:44:40.538 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T06:44:40.817 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-09-16T06:44:40.843 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T06:44:40.900 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T06:44:41.219 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T06:44:41.245 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T06:44:41.269 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T06:44:41.296 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:41.702 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T06:44:41.736 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:42.364 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-09-16T06:44:42.390 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T06:44:42.430 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T06:44:42.750 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T06:44:42.777 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T06:44:42.817 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T06:44:42.889 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-09-16T06:44:42.905 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:42.947 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:43.086 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T06:44:43.105 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:43.144 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:43.333 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T06:44:43.360 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:43.400 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:43.541 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T06:44:43.568 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:43.607 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:43.887 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T06:44:43.913 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:43.927 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T06:44:43.953 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T06:44:43.961 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:43.993 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T06:44:44.254 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T06:44:44.281 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T06:44:44.313 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T06:44:44.356 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-09-16T06:44:44.383 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-cephadm_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:44.422 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:44.658 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T06:44:44.684 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:44.732 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:44.734 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T06:44:44.761 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T06:44:44.800 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T06:44:45.137 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T06:44:45.144 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T06:44:45.164 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T06:44:45.170 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:45.203 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T06:44:45.243 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:45.797 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T06:44:45.824 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:45.863 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:46.258 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-babel. 2024-09-16T06:44:46.285 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T06:44:46.325 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T06:44:46.653 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T06:44:46.679 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T06:44:46.719 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T06:44:47.031 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-09-16T06:44:47.057 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:47.098 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T06:44:47.124 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:47.150 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:47.164 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:47.453 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T06:44:47.480 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:47.509 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T06:44:47.519 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:47.535 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T06:44:47.575 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T06:44:47.845 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-09-16T06:44:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-16T06:44:47.881 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T06:44:47.895 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T06:44:47.908 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:47.947 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:48.182 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T06:44:48.197 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T06:44:48.233 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T06:44:48.334 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-09-16T06:44:48.361 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-cephadm_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:44:48.400 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:48.526 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-toml. 2024-09-16T06:44:48.552 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-16T06:44:48.592 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T06:44:48.720 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T06:44:48.747 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T06:44:48.786 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T06:44:48.895 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T06:44:48.922 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T06:44:48.962 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T06:44:49.073 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T06:44:49.099 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T06:44:49.139 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T06:44:49.307 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T06:44:49.334 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T06:44:49.374 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T06:44:49.676 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-09-16T06:44:49.703 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T06:44:49.743 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T06:44:50.097 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T06:44:50.123 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:50.163 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-09-16T06:44:50.205 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T06:44:50.244 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T06:44:50.597 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T06:44:50.624 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T06:44:50.664 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T06:44:51.025 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T06:44:51.052 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:51.092 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:51.412 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T06:44:51.439 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T06:44:51.478 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T06:44:51.518 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T06:44:51.534 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T06:44:51.576 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T06:44:51.723 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-09-16T06:44:51.738 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-16T06:44:51.773 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T06:44:52.072 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T06:44:52.093 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T06:44:52.098 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T06:44:52.121 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T06:44:52.138 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T06:44:52.159 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T06:44:52.466 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T06:44:52.493 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T06:44:52.504 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-09-16T06:44:52.530 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-16T06:44:52.533 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T06:44:52.570 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T06:44:52.844 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T06:44:52.871 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T06:44:52.873 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T06:44:52.900 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T06:44:52.910 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T06:44:52.940 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T06:44:53.279 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T06:44:53.306 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T06:44:53.345 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T06:44:53.615 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-09-16T06:44:53.618 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T06:44:53.642 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T06:44:53.643 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:53.673 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T06:44:53.677 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:54.002 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T06:44:54.029 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:54.068 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:54.655 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T06:44:54.682 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T06:44:54.721 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T06:44:55.076 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T06:44:55.103 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T06:44:55.142 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T06:44:55.274 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T06:44:55.289 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T06:44:55.332 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T06:44:55.463 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T06:44:55.489 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T06:44:55.529 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T06:44:55.827 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T06:44:55.832 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T06:44:55.843 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T06:44:55.859 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-16T06:44:55.885 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T06:44:55.898 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T06:44:56.218 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T06:44:56.245 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T06:44:56.247 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T06:44:56.275 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T06:44:56.285 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T06:44:56.314 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T06:44:56.609 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T06:44:56.630 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T06:44:56.636 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T06:44:56.657 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T06:44:56.675 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T06:44:56.696 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T06:44:56.991 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T06:44:57.018 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T06:44:57.057 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T06:44:57.377 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T06:44:57.384 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T06:44:57.404 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T06:44:57.412 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:57.443 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T06:44:57.450 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:58.066 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T06:44:58.082 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:44:58.124 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:44:58.337 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T06:44:58.364 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T06:44:58.395 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T06:44:58.410 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T06:44:58.426 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T06:44:58.460 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T06:44:58.733 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T06:44:58.760 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T06:44:58.800 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T06:44:58.805 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T06:44:58.833 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T06:44:58.871 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T06:44:59.115 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-09-16T06:44:59.131 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T06:44:59.162 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T06:44:59.174 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T06:44:59.189 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T06:44:59.228 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T06:44:59.418 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-09-16T06:44:59.446 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T06:44:59.484 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T06:44:59.523 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T06:44:59.550 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-16T06:44:59.589 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T06:44:59.746 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T06:44:59.762 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T06:44:59.796 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T06:44:59.904 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T06:44:59.928 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T06:44:59.968 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T06:45:00.133 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-09-16T06:45:00.149 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-ceph-test_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:00.191 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:00.280 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T06:45:00.307 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T06:45:00.346 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T06:45:00.658 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T06:45:00.685 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T06:45:00.724 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T06:45:01.044 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T06:45:01.071 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T06:45:01.111 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T06:45:01.758 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T06:45:01.774 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:45:01.808 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:02.137 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T06:45:02.164 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T06:45:02.203 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T06:45:02.229 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T06:45:02.257 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:45:02.562 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:02.770 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T06:45:02.797 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T06:45:02.865 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T06:45:02.894 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:02.932 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:03.005 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T06:45:03.250 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-09-16T06:45:03.266 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T06:45:03.293 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T06:45:03.308 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T06:45:03.321 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T06:45:03.360 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T06:45:03.578 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-09-16T06:45:03.605 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T06:45:03.644 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T06:45:03.665 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T06:45:03.681 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T06:45:03.723 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T06:45:03.948 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T06:45:03.975 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T06:45:04.006 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T06:45:04.118 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T06:45:04.134 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T06:45:04.175 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T06:45:04.360 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-09-16T06:45:04.388 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-ceph-test_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:04.426 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:04.488 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T06:45:04.516 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T06:45:04.554 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T06:45:04.865 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T06:45:04.893 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T06:45:04.932 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T06:45:05.403 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T06:45:05.430 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T06:45:05.469 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T06:45:05.740 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T06:45:05.756 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T06:45:05.790 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T06:45:06.018 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T06:45:06.034 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T06:45:06.067 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T06:45:06.381 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T06:45:06.409 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T06:45:06.447 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:06.751 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T06:45:06.767 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:06.797 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-09-16T06:45:06.809 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:06.825 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-radosgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:06.855 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:07.188 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T06:45:07.216 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T06:45:07.254 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T06:45:07.575 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T06:45:07.600 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:07.609 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T06:45:07.637 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T06:45:07.641 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:07.675 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T06:45:07.945 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T06:45:08.088 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T06:45:08.115 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T06:45:08.154 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T06:45:08.196 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T06:45:08.322 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T06:45:08.466 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T06:45:08.493 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T06:45:08.524 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T06:45:08.573 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T06:45:08.894 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T06:45:08.898 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T06:45:08.921 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T06:45:08.968 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T06:45:09.335 INFO:teuthology.orchestra.run.smithi096.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T06:45:09.399 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:09.431 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T06:45:09.459 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T06:45:09.497 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T06:45:09.817 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T06:45:09.844 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T06:45:09.883 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T06:45:09.916 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-09-16T06:45:10.072 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T06:45:10.161 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T06:45:10.177 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T06:45:10.219 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T06:45:10.340 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T06:45:10.592 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T06:45:10.718 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T06:45:10.965 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-09-16T06:45:10.968 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T06:45:10.993 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-radosgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:11.031 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:11.212 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T06:45:11.330 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T06:45:11.665 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T06:45:11.760 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T06:45:11.775 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T06:45:11.818 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:12.016 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T06:45:12.096 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T06:45:12.268 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T06:45:12.364 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T06:45:12.474 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T06:45:12.544 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T06:45:12.720 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T06:45:12.887 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T06:45:13.017 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T06:45:13.146 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T06:45:13.397 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:13.424 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T06:45:13.526 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:13.648 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T06:45:13.758 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T06:45:14.017 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T06:45:14.093 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-09-16T06:45:14.160 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T06:45:14.283 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T06:45:14.527 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T06:45:14.679 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T06:45:14.794 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T06:45:14.972 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T06:45:15.062 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T06:45:15.188 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T06:45:15.231 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T06:45:15.456 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T06:45:15.515 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T06:45:15.698 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T06:45:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T06:45:16.104 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T06:45:16.167 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T06:45:16.427 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T06:45:16.453 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T06:45:16.553 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T06:45:16.679 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T06:45:16.713 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T06:45:16.989 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T06:45:17.155 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T06:45:17.240 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T06:45:17.491 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T06:45:17.514 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T06:45:17.734 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:17.757 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T06:45:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T06:45:18.134 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T06:45:18.264 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T06:45:18.427 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T06:45:18.729 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T06:45:18.770 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T06:45:18.855 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T06:45:19.021 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T06:45:19.147 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T06:45:19.357 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T06:45:19.448 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T06:45:19.608 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T06:45:19.766 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T06:45:19.868 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T06:45:20.178 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T06:45:20.813 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T06:45:20.939 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:45:21.064 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T06:45:21.073 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T06:45:21.198 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T06:45:21.316 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T06:45:21.324 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T06:45:21.452 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T06:45:21.568 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T06:45:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T06:45:21.853 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T06:45:21.985 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T06:45:22.112 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T06:45:22.236 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T06:45:22.363 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:45:22.489 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T06:45:22.607 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T06:45:22.629 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T06:45:22.917 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T06:45:22.930 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T06:45:23.168 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T06:45:23.282 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T06:45:23.402 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T06:45:23.525 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T06:45:23.626 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:23.662 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T06:45:23.913 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T06:45:23.927 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T06:45:24.172 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T06:45:24.245 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T06:45:24.298 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T06:45:24.574 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T06:45:24.692 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T06:45:24.985 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T06:45:25.261 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T06:45:25.376 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:45:25.512 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T06:45:25.518 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T06:45:25.778 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T06:45:25.902 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T06:45:25.904 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T06:45:26.030 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T06:45:26.132 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T06:45:26.258 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T06:45:26.331 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T06:45:26.607 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T06:45:26.668 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T06:45:26.850 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:45:26.919 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T06:45:26.959 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T06:45:27.094 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T06:45:27.170 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:45:27.296 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T06:45:27.396 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T06:45:27.622 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T06:45:27.655 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T06:45:27.923 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T06:45:27.923 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T06:45:28.182 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T06:45:28.191 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T06:45:28.309 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T06:45:28.425 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T06:45:28.568 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T06:45:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T06:45:28.802 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T06:45:28.836 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T06:45:29.078 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T06:45:29.095 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T06:45:29.204 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T06:45:29.481 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T06:45:29.489 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T06:45:29.774 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T06:45:29.774 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T06:45:30.016 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T06:45:30.109 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T06:45:30.235 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:30.370 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:30.422 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T06:45:30.496 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:30.621 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:30.678 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T06:45:30.748 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:30.804 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T06:45:30.976 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T06:45:31.188 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T06:45:31.235 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:31.362 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:31.448 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T06:45:31.488 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:31.699 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T06:45:31.704 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T06:45:31.704 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T06:45:31.808 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T06:45:32.109 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T06:45:32.389 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:32.402 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T06:45:32.649 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:32.678 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T06:45:32.775 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T06:45:32.804 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T06:45:33.072 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T06:45:33.323 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T06:45:33.574 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T06:45:33.976 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T06:45:34.013 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:34.139 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:34.248 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:34.294 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T06:45:34.349 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:34.654 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T06:45:34.755 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:34.856 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:34.966 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:35.034 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-09-16T06:45:35.092 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:35.218 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:35.429 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-09-16T06:45:35.454 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T06:45:35.564 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-09-16T06:45:35.583 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T06:45:35.721 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T06:45:35.731 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:35.832 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:35.958 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:36.089 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T06:45:36.169 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T06:45:36.169 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T06:45:36.586 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:36.635 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:36.712 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:36.761 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:36.887 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T06:45:37.298 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T06:45:37.299 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T06:45:37.764 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:38.071 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T06:45:38.133 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:38.251 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:38.385 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:38.511 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:38.549 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:38.638 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T06:45:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T06:45:39.106 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-09-16T06:45:39.217 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:39.435 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T06:45:39.435 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T06:45:39.457 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-09-16T06:45:39.626 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-09-16T06:45:39.644 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T06:45:39.775 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T06:45:39.902 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:40.071 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T06:45:40.169 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T06:45:40.169 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T06:45:40.539 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:40.640 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:40.763 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:40.914 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:41.091 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T06:45:41.091 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T06:45:41.127 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T06:45:41.127 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T06:45:41.542 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:41.648 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:41.791 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:41.892 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:41.896 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T06:45:42.043 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:42.354 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:42.397 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T06:45:42.566 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T06:45:42.567 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T06:45:43.031 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:43.229 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T06:45:43.229 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T06:45:43.690 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:43.903 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T06:45:43.971 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T06:45:43.971 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T06:45:44.382 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T06:45:44.388 DEBUG:teuthology.parallel:result is None 2024-09-16T06:45:44.442 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:44.593 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:44.772 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T06:45:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T06:45:45.462 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:45.630 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:45.771 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:45.924 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T06:45:46.276 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T06:45:47.393 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T06:45:47.877 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T06:45:47.882 DEBUG:teuthology.parallel:result is None 2024-09-16T06:45:47.883 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T06:45:48.025 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-09-16T06:45:48.044 INFO:teuthology.orchestra.run.smithi096.stdout:18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:45:48.045 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:45:48.045 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1jammy is installed. 2024-09-16T06:45:48.047 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T06:45:48.187 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-09-16T06:45:48.206 INFO:teuthology.orchestra.run.smithi134.stdout:18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:45:48.206 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T06:45:48.206 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1jammy is installed. 2024-09-16T06:45:48.208 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T06:45:48.208 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:48.208 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T06:45:48.223 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:48.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T06:45:48.263 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T06:45:48.263 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:48.263 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T06:45:48.277 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T06:45:48.332 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:48.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T06:45:48.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T06:45:48.401 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T06:45:48.401 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:48.401 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T06:45:48.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T06:45:48.468 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:48.468 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T06:45:48.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T06:45:48.541 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T06:45:48.541 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:48.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T06:45:48.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T06:45:48.608 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:48.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T06:45:48.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T06:45:48.677 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T06:45:48.757 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T06:45:48.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-09-16T06:45:48.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-16T06:45:48.772 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T06:45:48.773 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T06:45:48.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T06:45:48.829 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T06:45:48.829 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T06:45:48.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T06:45:48.889 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-16T06:45:48.890 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-16T06:45:48.890 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-16T06:45:48.890 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:48.890 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T06:45:48.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T06:45:49.004 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:49.004 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T06:45:49.010 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T06:45:49.091 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T06:45:49.091 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', 'replacing it with standby', 'No standby daemons available', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T06:45:49.091 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574', 'branch': 'reef', 'description': 'rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/workunits}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906574', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 2, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 931, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'], ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1']], 'seed': 1390, 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'sleep_before_teardown': 0, 'subset': '5319/100000', 'suite': 'rados', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6', 'targets': {'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAUQEvIcRAGzwIJ5py/x/mOaYHE1GGXu4ES6E5yIZmn0M9Li9YKfDZuEIu5pw4TOr0YB+OdUEtOv6XHgi2xl7hI=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdhVaAJv0Lhq8WgPNw9gNBkEvJHlBbivkqIGRNdFb0vbPXAIGedhpdSnqk5Jjfjs2kCmPOEzo7ZOC6ZOupxMSE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', 'replacing it with standby', 'No standby daemons available', '\\(POOL_APP_NOT_ENABLED\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'wait-for-scrub': False, 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['mgr/test_localpool.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_22:00:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T06:45:49.092 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T06:45:49.094 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T06:45:49.134 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T06:45:49.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T06:45:49.190 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:49.190 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T06:45:49.209 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T06:45:49.210 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-16 06:40:28.086679217 +0000 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-16 06:40:27.834681467 +0000 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-16 06:40:27.834681467 +0000 2024-09-16T06:45:49.258 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-16T06:45:49.258 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T06:45:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-16T06:45:49.312 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-16T06:45:49.312 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00038749 s, 1.3 MB/s 2024-09-16T06:45:49.313 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T06:45:49.363 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-09-16T06:45:49.411 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T06:45:49.411 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:49.411 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-16T06:45:49.412 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:49.412 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-16 06:40:28.574674858 +0000 2024-09-16T06:45:49.412 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-16 06:40:28.322677109 +0000 2024-09-16T06:45:49.412 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-16 06:40:28.322677109 +0000 2024-09-16T06:45:49.412 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-16T06:45:49.412 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T06:45:49.464 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-16T06:45:49.464 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-16T06:45:49.464 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000460209 s, 1.1 MB/s 2024-09-16T06:45:49.465 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T06:45:49.519 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-09-16T06:45:49.566 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T06:45:49.567 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:49.567 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-16T06:45:49.567 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:49.567 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-16 06:40:29.066670464 +0000 2024-09-16T06:45:49.568 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-16 06:40:28.802672821 +0000 2024-09-16T06:45:49.568 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-16 06:40:28.802672821 +0000 2024-09-16T06:45:49.568 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-16T06:45:49.568 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T06:45:49.620 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-16T06:45:49.620 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-16T06:45:49.620 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000419068 s, 1.2 MB/s 2024-09-16T06:45:49.621 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T06:45:49.671 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-09-16T06:45:49.717 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T06:45:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:49.718 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-09-16T06:45:49.718 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:49.718 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-09-16 06:40:29.530666318 +0000 2024-09-16T06:45:49.718 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-09-16 06:40:29.298668390 +0000 2024-09-16T06:45:49.718 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-09-16 06:40:29.298668390 +0000 2024-09-16T06:45:49.718 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2024-09-16T06:45:49.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T06:45:49.772 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-09-16T06:45:49.772 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-09-16T06:45:49.772 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000387512 s, 1.3 MB/s 2024-09-16T06:45:49.773 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T06:45:49.822 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-16T06:45:49.823 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:49.823 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T06:45:49.828 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T06:45:49.828 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 06:40:24.151367966 +0000 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 06:40:23.875370431 +0000 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 06:40:23.875370431 +0000 2024-09-16T06:45:49.874 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-16T06:45:49.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T06:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T06:45:49.928 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T06:45:49.929 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000449177 s, 1.1 MB/s 2024-09-16T06:45:49.930 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T06:45:49.979 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-16T06:45:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T06:45:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:50.026 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-16T06:45:50.026 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:50.026 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 06:40:24.679363249 +0000 2024-09-16T06:45:50.026 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 06:40:24.419365571 +0000 2024-09-16T06:45:50.026 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 06:40:24.419365571 +0000 2024-09-16T06:45:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-16T06:45:50.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T06:45:50.079 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T06:45:50.079 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T06:45:50.079 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000432293 s, 1.2 MB/s 2024-09-16T06:45:50.081 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T06:45:50.130 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-16T06:45:50.177 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T06:45:50.178 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-16T06:45:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 06:40:25.227358355 +0000 2024-09-16T06:45:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 06:40:24.923361070 +0000 2024-09-16T06:45:50.178 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 06:40:24.923361070 +0000 2024-09-16T06:45:50.178 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-16T06:45:50.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T06:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T06:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T06:45:50.232 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000409274 s, 1.3 MB/s 2024-09-16T06:45:50.233 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T06:45:50.283 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 06:40:25.719353961 +0000 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 06:40:25.471356176 +0000 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 06:40:25.471356176 +0000 2024-09-16T06:45:50.330 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-16T06:45:50.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T06:45:50.384 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T06:45:50.384 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T06:45:50.384 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000384191 s, 1.3 MB/s 2024-09-16T06:45:50.385 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T06:45:50.435 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-16T06:45:50.435 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-16T06:45:50.435 INFO:tasks.ceph:Generating config... 2024-09-16T06:45:50.436 INFO:tasks.ceph:[client] debug client = 20 2024-09-16T06:45:50.437 INFO:tasks.ceph:[client] debug mgrc = 20 2024-09-16T06:45:50.437 INFO:tasks.ceph:[client] debug ms = 1 2024-09-16T06:45:50.437 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mds] debug mgrc = 20 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mgr] mgr ttl cache expire seconds = 0 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T06:45:50.437 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T06:45:50.437 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T06:45:50.437 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] debug mgrc = 20 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T06:45:50.438 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T06:45:50.439 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T06:45:50.439 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T06:45:50.473 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T06:45:50.497 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T06:45:50.577 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T06:45:50.634 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.c', '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]'), ('mon.b', '172.21.15.134')] 2024-09-16T06:45:50.634 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],172.21.15.134', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mgrc': 20}} 2024-09-16T06:45:50.635 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:50.635 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T06:45:50.682 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --addv c '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]' --add b 172.21.15.134 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:45:50.767 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:45:50.767 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid 63031869-dae1-491e-928d-826cedeb9570 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = pacific 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:fsid 63031869-dae1-491e-928d-826cedeb9570 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2024-09-16T06:45:50.768455+0000 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-09-16T06:45:50.768455+0000 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 16 (pacific) 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 3 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] mon.c 2024-09-16T06:45:50.768 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-16T06:45:50.769 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T06:45:50.819 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 63031869-dae1-491e-928d-826cedeb9570... 2024-09-16T06:45:50.820 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T06:45:50.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.892 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T06:45:50.893 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-09-16T06:45:50.894 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],172.21.15.134" 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: mon election default strategy = 3 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 63031869-dae1-491e-928d-826cedeb9570 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-09-16T06:45:50.895 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-09-16T06:45:50.896 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-09-16T06:45:50.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression algorithm = zlib 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgrc = 20 2024-09-16T06:45:50.898 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-16T06:45:50.899 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: mgr ttl cache expire seconds = 0 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-09-16T06:45:50.900 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T06:45:50.901 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-09-16T06:45:50.902 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgrc = 20 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2024-09-16T06:45:50.903 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgrc = 20 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.904 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T06:45:50.905 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T06:45:50.906 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.907 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],172.21.15.134" 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: mon election default strategy = 3 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 63031869-dae1-491e-928d-826cedeb9570 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-16T06:45:50.908 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-16T06:45:50.909 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression algorithm = zlib 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression mode = aggressive 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-09-16T06:45:50.910 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgrc = 20 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-16T06:45:50.911 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: mgr ttl cache expire seconds = 0 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.912 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T06:45:50.913 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-16T06:45:50.914 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgrc = 20 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-09-16T06:45:50.915 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgrc = 20 2024-09-16T06:45:50.917 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T06:45:50.918 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T06:45:51.006 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T06:45:51.006 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:51.006 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T06:45:51.011 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:51.011 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T06:45:51.057 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-09-16T06:45:51.057 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:51.057 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T06:45:51.057 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T06:45:51.122 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:45:51.122 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:45:51.169 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:45:51.169 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:51.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T06:45:51.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T06:45:51.191 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:45:51.191 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:45:51.237 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T06:45:51.238 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T06:45:51.238 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T06:45:51.281 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T06:45:51.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T06:45:51.326 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T06:45:51.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2024-09-16T06:45:51.429 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2024-09-16T06:45:51.432 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T06:45:51.432 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T06:45:51.478 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T06:45:51.481 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-16T06:45:51.537 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T06:45:51.622 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T06:45:51.626 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-16T06:45:51.680 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T06:45:51.726 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T06:45:51.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-16T06:45:51.785 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T06:45:51.785 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T06:45:51.822 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T06:45:51.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T06:45:51.870 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T06:45:51.881 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T06:45:51.881 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-16T06:45:51.881 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T06:45:51.894 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-16T06:45:51.894 INFO:tasks.ceph:role: osd.0 2024-09-16T06:45:51.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-16T06:45:51.894 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T06:45:51.957 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T06:45:51.958 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T06:45:52.438 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-09-16T06:45:52.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-09-16T06:45:52.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T06:45:52.598 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T06:45:52.610 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T06:45:52.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:45:52.611 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:45:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:45:52.724+0000 7fbbea4947c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T06:45:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:45:52.728+0000 7fbbea4947c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T06:45:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:45:52.728+0000 7fbbea4947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T06:45:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:45:52.728+0000 7fbbea4947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T06:45:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:45:52.728+0000 7fbbea4947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T06:45:52.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:45:52.736+0000 7fbbea4947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T06:45:55.719 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T06:45:55.732 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T06:45:55.746 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-16T06:45:55.746 INFO:tasks.ceph:role: osd.1 2024-09-16T06:45:55.746 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:45:55.746 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T06:45:55.809 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T06:45:55.810 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T06:45:56.263 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-16T06:45:56.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-16T06:45:56.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-16T06:45:56.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T06:45:56.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:45:56.403 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T06:45:56.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T06:45:56.455 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-16T06:45:56.456 INFO:tasks.ceph:role: osd.2 2024-09-16T06:45:56.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:45:56.456 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T06:45:56.518 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T06:45:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T06:45:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T06:45:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T06:45:56.518 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T06:45:56.518 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-16T06:45:56.518 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T06:45:56.519 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T06:45:56.519 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T06:45:56.519 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T06:45:56.991 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-16T06:45:56.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-16T06:45:56.993 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-16T06:45:57.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T06:45:57.163 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T06:45:57.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:45:57.164 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T06:45:57.217 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-16T06:45:57.217 INFO:tasks.ceph:role: osd.3 2024-09-16T06:45:57.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:45:57.217 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T06:45:57.281 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T06:45:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T06:45:57.283 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T06:45:57.746 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-16T06:45:57.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-16T06:45:57.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-16T06:45:57.889 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T06:45:57.899 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T06:45:57.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:45:57.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:45:58.030 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:45:58.032+0000 7f75ec9e67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T06:45:58.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:45:58.032+0000 7f75ec9e67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T06:45:58.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:45:58.032+0000 7f75ec9e67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T06:45:58.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:45:58.032+0000 7f75ec9e67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T06:45:58.031 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:45:58.032+0000 7f75ec9e67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T06:45:58.032 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:45:58.032+0000 7f75ec9e67c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T06:46:01.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T06:46:01.034 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:46:01.116 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:01.116+0000 7f35bedb07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T06:46:01.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:01.116+0000 7f35bedb07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T06:46:01.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:01.120+0000 7f35bedb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T06:46:01.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:01.120+0000 7f35bedb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T06:46:01.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:01.120+0000 7f35bedb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T06:46:01.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:01.120+0000 7f35bedb07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T06:46:04.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T06:46:04.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:46:04.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:04.236+0000 7fdc13e2e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T06:46:04.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:04.240+0000 7fdc13e2e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T06:46:04.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:04.240+0000 7fdc13e2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T06:46:04.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:04.240+0000 7fdc13e2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T06:46:04.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:04.240+0000 7fdc13e2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T06:46:04.238 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:04.240+0000 7fdc13e2e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T06:46:07.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T06:46:07.269 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T06:46:07.270 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:46:07.270 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T06:46:07.285 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:46:07.285 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-16T06:46:07.341 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:46:07.342 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-16T06:46:07.401 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:46:07.401 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T06:46:07.461 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:07.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-16T06:46:07.474 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:07.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2024-09-16T06:46:07.528 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:07.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-16T06:46:07.580 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:07.580 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T06:46:07.632 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:07.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T06:46:07.684 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:07.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T06:46:07.737 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:46:07.737 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T06:46:07.742 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:07.743 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T06:46:07.785 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T06:46:07.786 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T06:46:07.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T06:46:07.831 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1OdmiFfVEBAAzNMSPl6Dq8lYykmF+z03OQ== 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1OdmdMKQHBAAl1nzK0e1v9Ljbba+T4EVlg== 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1OdmUIAoJRAAunj85znwrIsunZHuGQi6fw== 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAg1OdmJOhXKxAAM8I4oIXbZenbEa68bK1drQ== 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1OdmUVDIExAA4b/9lgf5oHMP3K8SICgtjA== 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.z] 2024-09-16T06:46:07.832 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1Odm1+zpGRAApo4jSCNCtnK0NclvgfEpDg== 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1OdmbIuZKxAAuhNZoEoeeyuLbCi8ZLpStQ== 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAm1Odmj1MjAhAAP+y2D0TgzBe1em9icSmHsg== 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAp1OdmfcNDBxAA9r8/wcTrQd0aZFcxN17Bnw== 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAs1Odm2fZsDhAApnJBtS6UvUZvrAhgBLA8cA== 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1Odma1gVMRAAA4KVxvpoHJIxnuwH+KqTmA== 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout:[client.1] 2024-09-16T06:46:07.833 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAf1OdmlUkvNBAAvi7+F5wNoPHTokNfCJDzIA== 2024-09-16T06:46:07.839 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-09-16T06:46:07.839 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1OdmiFfVEBAAzNMSPl6Dq8lYykmF+z03OQ== 2024-09-16T06:46:07.839 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-16T06:46:07.839 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1OdmdMKQHBAAl1nzK0e1v9Ljbba+T4EVlg== 2024-09-16T06:46:07.839 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-16T06:46:07.839 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1OdmUIAoJRAAunj85znwrIsunZHuGQi6fw== 2024-09-16T06:46:07.839 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAg1OdmJOhXKxAAM8I4oIXbZenbEa68bK1drQ== 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1OdmUVDIExAA4b/9lgf5oHMP3K8SICgtjA== 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.z] 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1Odm1+zpGRAApo4jSCNCtnK0NclvgfEpDg== 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1OdmbIuZKxAAuhNZoEoeeyuLbCi8ZLpStQ== 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAm1Odmj1MjAhAAP+y2D0TgzBe1em9icSmHsg== 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAp1OdmfcNDBxAA9r8/wcTrQd0aZFcxN17Bnw== 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAs1Odm2fZsDhAApnJBtS6UvUZvrAhgBLA8cA== 2024-09-16T06:46:07.840 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-16T06:46:07.841 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1Odma1gVMRAAA4KVxvpoHJIxnuwH+KqTmA== 2024-09-16T06:46:07.841 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-09-16T06:46:07.841 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQAf1OdmlUkvNBAAvi7+F5wNoPHTokNfCJDzIA== 2024-09-16T06:46:07.842 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T06:46:07.878 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T06:46:07.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T06:46:07.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T06:46:08.018 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T06:46:08.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T06:46:08.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.143 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T06:46:08.146 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T06:46:08.227 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T06:46:08.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T06:46:08.308 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T06:46:08.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T06:46:08.391 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.471 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.486 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.551 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.570 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T06:46:08.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T06:46:08.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T06:46:08.715 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T06:46:08.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T06:46:08.798 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T06:46:08.798 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T06:46:08.811 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T06:46:08.897 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T06:46:08.951 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-16T06:46:09.002 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T06:46:09.092 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-16T06:46:09.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-16T06:46:09.118 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T06:46:09.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-16T06:46:09.224 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:46:09.227 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T06:46:09.272 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T06:46:09.273 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T06:46:09.273 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T06:46:09.275 INFO:tasks.ceph.mon.a:Started 2024-09-16T06:46:09.276 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-16T06:46:09.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-16T06:46:09.278 INFO:tasks.ceph.mon.c:Started 2024-09-16T06:46:09.278 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-16T06:46:09.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-16T06:46:09.319 INFO:tasks.ceph.mon.b:Started 2024-09-16T06:46:09.319 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T06:46:09.319 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T06:46:09.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T06:46:09.324 INFO:tasks.ceph.mgr.x:Started 2024-09-16T06:46:09.324 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-16T06:46:09.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-16T06:46:09.326 INFO:tasks.ceph.mgr.y:Started 2024-09-16T06:46:09.327 INFO:tasks.ceph.mgr.z:Restarting daemon 2024-09-16T06:46:09.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2024-09-16T06:46:09.328 INFO:tasks.ceph.mgr.z:Started 2024-09-16T06:46:09.329 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T06:46:09.329 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T06:46:09.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57c9f2640 1 Processor -- start 2024-09-16T06:46:09.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57c9f2640 1 -- start start 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57c9f2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57c9f2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780ba1c0 con 0x7fc5780b9de0 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57c9f2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780aa0c0 con 0x7fc5780ab5d0 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57c9f2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780a8690 con 0x7fc578139ce0 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc575d9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc5780b9de0 0x7fc578147300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36720/0 (socket says 172.21.15.96:36720) 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 learned_addr learned my addr 172.21.15.96:0/3449698140 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:09.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:09.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:09.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:09.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.440+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:46:09.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.644+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:09.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.644+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:09.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.644+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:09.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.644+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:09.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:09.644+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:46:10.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.048+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:10.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.048+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:10.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.048+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:10.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.048+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:10.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.048+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T06:46:10.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.852+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:10.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.852+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:10.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.852+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:10.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.852+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:10.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:10.852+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T06:46:12.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 msgr2=0x7fc5780ab090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T06:46:12.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578139ce0 0x7fc5780ab090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:12.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 >> v1:172.21.15.134:6789/0 conn(0x7fc5780ab5d0 legacy=0x7fc57814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:12.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 >> v1:172.21.15.96:6789/0 conn(0x7fc5780b9de0 legacy=0x7fc578147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:12.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:12.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc558008dc0 con 0x7fc558003720 2024-09-16T06:46:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.440+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc558008f30 con 0x7fc558006290 2024-09-16T06:46:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T06:46:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:46:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.444+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:12.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:12.648+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:46:13.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.052+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T06:46:13.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T06:46:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T06:46:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:13.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:13.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:13.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:13.856+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T06:46:15.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.134:3300/0 conn(0x7fc558006290 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 msgr2=0x7fc558005ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc558003720 0x7fc558005ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc576d9d640 1 -- 172.21.15.96:0/3449698140 reap_dead start 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc578146d90 con 0x7fc558009c50 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc558008dc0 con 0x7fc5580092e0 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc567fff640 1 -- 172.21.15.96:0/3449698140 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc558008f30 con 0x7fc558005c40 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 msgr2=0x7fc5580096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 msgr2=0x7fc5580096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:15.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.444+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:46:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-16T06:46:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc575d9b640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 msgr2=0x7fc5580096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-16T06:46:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc57659c640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 msgr2=0x7fc5580096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T06:46:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:46:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:46:15.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.648+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:46:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.692+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884291714 0 0) 0x7fc578146d90 con 0x7fc558009c50 2024-09-16T06:46:15.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.692+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc560003530 con 0x7fc558009c50 2024-09-16T06:46:15.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.692+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3198906243 0 0) 0x7fc560003530 con 0x7fc558009c50 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 msgr2=0x7fc558008730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc558008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 msgr2=0x7fc5580096c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 --2- 172.21.15.96:0/3449698140 >> v2:172.21.15.96:3300/0 conn(0x7fc5580092e0 0x7fc5580096c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55800ea80 con 0x7fc558009c50 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 633242010 0 0) 0x7fc5700018b0 con 0x7fc558009c50 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 >> v1:172.21.15.96:6789/0 conn(0x7fc558009c50 legacy=0x7fc55800c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc560003980 0x7fc560003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5600047d0 0x7fc560004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc560005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc558008dc0 con 0x7fc560003980 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc558008f30 con 0x7fc5600047d0 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56000bac0 con 0x7fc558005c40 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc57659c640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc560003980 0x7fc560003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc576d9d640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc560005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc575d9b640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5600047d0 0x7fc560004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc576d9d640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5600047d0 msgr2=0x7fc560004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc576d9d640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5600047d0 0x7fc560004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc576d9d640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc560003980 msgr2=0x7fc560003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:15.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc576d9d640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc560003980 0x7fc560003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.696+0000 7fc576d9d640 1 -- 172.21.15.96:0/3449698140 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560003530 con 0x7fc558005c40 2024-09-16T06:46:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc576d9d640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc560005190 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc578072760 tx=0x7fc57001d080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74ce0fa93596038e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570005d50 con 0x7fc558005c40 2024-09-16T06:46:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5700a5b00 con 0x7fc558005c40 2024-09-16T06:46:15.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57559a640 1 -- 172.21.15.96:0/3449698140 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570007070 con 0x7fc558005c40 2024-09-16T06:46:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57c9f2640 1 -- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 msgr2=0x7fc560005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57c9f2640 1 --2- 172.21.15.96:0/3449698140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc558005c40 0x7fc560005190 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc578072760 tx=0x7fc57001d080 comp rx=0 tx=0).stop 2024-09-16T06:46:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc576d9d640 1 -- 172.21.15.96:0/3449698140 reap_dead start 2024-09-16T06:46:15.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57c9f2640 1 -- 172.21.15.96:0/3449698140 shutdown_connections 2024-09-16T06:46:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57c9f2640 1 -- 172.21.15.96:0/3449698140 >> 172.21.15.96:0/3449698140 conn(0x7fc578072b70 msgr2=0x7fc578072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57c9f2640 1 -- 172.21.15.96:0/3449698140 shutdown_connections 2024-09-16T06:46:15.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.700+0000 7fc57c9f2640 1 -- 172.21.15.96:0/3449698140 wait complete. 2024-09-16T06:46:15.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 Processor -- start 2024-09-16T06:46:15.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 -- start start 2024-09-16T06:46:15.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc578134b40 0x7fc578134f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578143ff0 0x7fc5781dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5781dc5e0 0x7fc5781dac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578135cc0 con 0x7fc578134b40 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781359f0 con 0x7fc5781dc5e0 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57c9f2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc578134340 con 0x7fc578143ff0 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc575d9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578143ff0 0x7fc5781dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc57659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc578134b40 0x7fc578134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc575d9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578143ff0 0x7fc5781dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:57892/0 (socket says 172.21.15.96:57892) 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc575d9b640 1 -- 172.21.15.96:0/2231442101 learned_addr learned my addr 172.21.15.96:0/2231442101 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.704+0000 7fc576d9d640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5781dc5e0 0x7fc5781dac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc575d9b640 1 -- 172.21.15.96:0/2231442101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5781dc5e0 msgr2=0x7fc5781dac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc575d9b640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5781dc5e0 0x7fc5781dac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc575d9b640 1 -- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc578134b40 msgr2=0x7fc578134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc575d9b640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc578134b40 0x7fc578134f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc575d9b640 1 -- 172.21.15.96:0/2231442101 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578135460 con 0x7fc578143ff0 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc57659c640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc578134b40 0x7fc578134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc575d9b640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578143ff0 0x7fc5781dc0a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc56c017ae0 tx=0x7fc56c017ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 1 -- 172.21.15.96:0/2231442101 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c028070 con 0x7fc578143ff0 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc578133d70 con 0x7fc578143ff0 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5781db390 con 0x7fc578143ff0 2024-09-16T06:46:15.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 1 -- 172.21.15.96:0/2231442101 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c016b10 con 0x7fc578143ff0 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 1 -- 172.21.15.96:0/2231442101 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c016c80 con 0x7fc578143ff0 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 1 -- 172.21.15.96:0/2231442101 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc56c024420 con 0x7fc578143ff0 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 20 mgrc handle_mgr_map mgrmap(e 1) v1 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 4 mgrc handle_mgr_map Got map version 1 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc566ffd640 1 -- 172.21.15.96:0/2231442101 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc56c02d410 con 0x7fc578143ff0 2024-09-16T06:46:15.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.708+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c005050 con 0x7fc578143ff0 2024-09-16T06:46:15.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.724+0000 7fc566ffd640 1 -- 172.21.15.96:0/2231442101 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc56c024810 con 0x7fc578143ff0 2024-09-16T06:46:15.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.788+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc55c0055d0 con 0x7fc578143ff0 2024-09-16T06:46:15.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc566ffd640 1 -- 172.21.15.96:0/2231442101 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc56c0249b0 con 0x7fc578143ff0 2024-09-16T06:46:15.800 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2024-09-16T06:46:15.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 10 mgrc shutdown 2024-09-16T06:46:15.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578143ff0 msgr2=0x7fc5781dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:15.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578143ff0 0x7fc5781dc0a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc56c017ae0 tx=0x7fc56c017ee0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 shutdown_connections 2024-09-16T06:46:15.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5781dc5e0 0x7fc5781dac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc578143ff0 0x7fc5781dc0a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 --2- 172.21.15.96:0/2231442101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc578134b40 0x7fc578134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:15.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 >> 172.21.15.96:0/2231442101 conn(0x7fc578072b70 msgr2=0x7fc5780b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:15.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 shutdown_connections 2024-09-16T06:46:15.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:15.796+0000 7fc57c9f2640 1 -- 172.21.15.96:0/2231442101 wait complete. 2024-09-16T06:46:15.820 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T06:46:15.820 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T06:46:15.821 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:46:15.821 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T06:46:15.833 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:15.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T06:46:15.848 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:15.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T06:46:15.902 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T06:46:15.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T06:46:15.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 26c284cc-940d-494a-ac78-5af651c9336a 0 2024-09-16T06:46:15.958 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:15.956+0000 7fa6a7388180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:46:15.990 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:15.992+0000 7f60a6e9c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:46:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.108+0000 7fb7ea361640 1 Processor -- start 2024-09-16T06:46:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.108+0000 7fb7ea361640 1 -- start start 2024-09-16T06:46:16.109 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.108+0000 7fb7ea361640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 0x7fb7e40a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.108+0000 7fb7ea361640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb7e40a6b60 0x7fb7e40a6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.108+0000 7fb7ea361640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e4147990 con 0x7fb7e40a3c70 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.108+0000 7fb7ea361640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e40a5200 con 0x7fb7e40a6b60 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.108+0000 7fb7ea361640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4146b50 con 0x7fb7e4142ee0 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb7e40a6b60 0x7fb7e40a6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb7e40a6b60 0x7fb7e40a6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55364/0 (socket says 172.21.15.134:55364) 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 -- 172.21.15.134:0/3433172580 learned_addr learned my addr 172.21.15.134:0/3433172580 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e3fff640 1 --2- 172.21.15.134:0/3433172580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 0x7fb7e40a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 -- 172.21.15.134:0/3433172580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 msgr2=0x7fb7e40a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 --2- 172.21.15.134:0/3433172580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 0x7fb7e40a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 -- 172.21.15.134:0/3433172580 >> v1:172.21.15.96:6789/0 conn(0x7fb7e40a3c70 legacy=0x7fb7e40a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.111 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 -- 172.21.15.134:0/3433172580 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4146dd0 con 0x7fb7e40a6b60 2024-09-16T06:46:16.112 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e88fe640 1 --2- 172.21.15.134:0/3433172580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a6b60 0x7fb7e40a6fd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009e50 tx=0x7fb7dc01c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d836ab19f95f31c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e2ffd640 1 -- 172.21.15.134:0/3433172580 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0a5730 con 0x7fb7e40a6b60 2024-09-16T06:46:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e2ffd640 1 -- 172.21.15.134:0/3433172580 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7dc0a5890 con 0x7fb7e40a6b60 2024-09-16T06:46:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.112+0000 7fb7e2ffd640 1 -- 172.21.15.134:0/3433172580 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0a5c20 con 0x7fb7e40a6b60 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- 172.21.15.134:0/3433172580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a6b60 msgr2=0x7fb7e40a6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 --2- 172.21.15.134:0/3433172580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a6b60 0x7fb7e40a6fd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009e50 tx=0x7fb7dc01c8f0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- 172.21.15.134:0/3433172580 shutdown_connections 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 --2- 172.21.15.134:0/3433172580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a6b60 0x7fb7e40a6fd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 --2- 172.21.15.134:0/3433172580 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 0x7fb7e40a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- 172.21.15.134:0/3433172580 >> 172.21.15.134:0/3433172580 conn(0x7fb7e4072b70 msgr2=0x7fb7e4072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- 172.21.15.134:0/3433172580 shutdown_connections 2024-09-16T06:46:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- 172.21.15.134:0/3433172580 wait complete. 2024-09-16T06:46:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 Processor -- start 2024-09-16T06:46:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- start start 2024-09-16T06:46:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a3c70 0x7fb7e40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40a6b60 0x7fb7e4070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 0x7fb7e4071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40715a0 con 0x7fb7e40a6b60 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4135340 con 0x7fb7e40a3c70 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4070340 con 0x7fb7e4142ee0 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a3c70 0x7fb7e40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a3c70 0x7fb7e40b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55376/0 (socket says 172.21.15.134:55376) 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 -- 172.21.15.134:0/2566753033 learned_addr learned my addr 172.21.15.134:0/2566753033 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 -- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 msgr2=0x7fb7e4071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 0x7fb7e4071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 -- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40a6b60 msgr2=0x7fb7e4070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e37fe640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40a6b60 0x7fb7e4070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40a6b60 0x7fb7e4070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 -- 172.21.15.134:0/2566753033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc009b30 con 0x7fb7e40a3c70 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e37fe640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40a6b60 0x7fb7e4070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e3fff640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a3c70 0x7fb7e40b5e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400d620 tx=0x7fb7d400dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 1 -- 172.21.15.134:0/2566753033 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400b620 con 0x7fb7e40a3c70 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 1 -- 172.21.15.134:0/2566753033 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400b780 con 0x7fb7e40a3c70 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e4070620 con 0x7fb7e40a3c70 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 1 -- 172.21.15.134:0/2566753033 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400bb10 con 0x7fb7e40a3c70 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e4141a50 con 0x7fb7e40a3c70 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 1 -- 172.21.15.134:0/2566753033 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb7d401e460 con 0x7fb7e40a3c70 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 20 mgrc handle_mgr_map mgrmap(e 1) v1 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 4 mgrc handle_mgr_map Got map version 1 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:46:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:46:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.116+0000 7fb7e0ff9640 1 -- 172.21.15.134:0/2566753033 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb7d4014560 con 0x7fb7e40a3c70 2024-09-16T06:46:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.120+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e40a6fd0 con 0x7fb7e40a3c70 2024-09-16T06:46:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.120+0000 7fb7e0ff9640 1 -- 172.21.15.134:0/2566753033 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb7d4014770 con 0x7fb7e40a3c70 2024-09-16T06:46:16.130 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:16.132+0000 7f90d42e6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:46:16.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.192+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26c284cc-940d-494a-ac78-5af651c9336a", "id": 0} v 0) v1 -- 0x7fb7e406a4a0 con 0x7fb7e40a3c70 2024-09-16T06:46:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.196+0000 7fb7e0ff9640 1 -- 172.21.15.134:0/2566753033 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26c284cc-940d-494a-ac78-5af651c9336a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb7d401ea80 con 0x7fb7e40a3c70 2024-09-16T06:46:16.196 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-09-16T06:46:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 10 mgrc shutdown 2024-09-16T06:46:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a3c70 msgr2=0x7fb7e40b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a3c70 0x7fb7e40b5e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400d620 tx=0x7fb7d400dae0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 shutdown_connections 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40a6b60 0x7fb7e4070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7e4142ee0 0x7fb7e4071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 --2- 172.21.15.134:0/2566753033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7e40a3c70 0x7fb7e40b5e40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 >> 172.21.15.134:0/2566753033 conn(0x7fb7e4072b70 msgr2=0x7fb7e41459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 shutdown_connections 2024-09-16T06:46:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.200+0000 7fb7ea361640 1 -- 172.21.15.134:0/2566753033 wait complete. 2024-09-16T06:46:16.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 955450ea-68e9-4215-985b-ce7892e1f2d8 1 2024-09-16T06:46:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88d6312640 1 Processor -- start 2024-09-16T06:46:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88d6312640 1 -- start start 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88d6312640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88d0140c60 0x7f88d00a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88d6312640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d00a4300 con 0x7f88d00a5310 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88d6312640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d0144aa0 con 0x7f88d0141040 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88d6312640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d00a5ce0 con 0x7f88d0140c60 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88cffff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f88d0140c60 0x7f88d00a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88cf7fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f88d0141040 0x7f88d006e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33214/0 (socket says 172.21.15.134:33214) 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88cf7fe640 1 -- 172.21.15.134:0/2476619386 learned_addr learned my addr 172.21.15.134:0/2476619386 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88cffff640 1 -- 172.21.15.134:0/2476619386 >> v1:172.21.15.134:6789/0 conn(0x7f88d0141040 legacy=0x7f88d006e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88ceffd640 1 -- 172.21.15.134:0/2476619386 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907337713 0 0) 0x7f88d0144aa0 con 0x7f88d0141040 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88cffff640 1 -- 172.21.15.134:0/2476619386 >> v1:172.21.15.96:6789/0 conn(0x7f88d00a5310 legacy=0x7f88d014bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.332+0000 7f88cffff640 1 -- 172.21.15.134:0/2476619386 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0144d60 con 0x7f88d0140c60 2024-09-16T06:46:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88cffff640 1 --2- 172.21.15.134:0/2476619386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d0140c60 0x7f88d00a3dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88d0144f50 tx=0x7f88c001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755a7c49b9c38c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88ceffd640 1 -- 172.21.15.134:0/2476619386 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00ab600 con 0x7f88d0140c60 2024-09-16T06:46:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88ceffd640 1 -- 172.21.15.134:0/2476619386 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00a7050 con 0x7f88d0140c60 2024-09-16T06:46:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88ceffd640 1 -- 172.21.15.134:0/2476619386 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00ab980 con 0x7f88d0140c60 2024-09-16T06:46:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 -- 172.21.15.134:0/2476619386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d0140c60 msgr2=0x7f88d00a3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 --2- 172.21.15.134:0/2476619386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d0140c60 0x7f88d00a3dc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88d0144f50 tx=0x7f88c001c360 comp rx=0 tx=0).stop 2024-09-16T06:46:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 -- 172.21.15.134:0/2476619386 shutdown_connections 2024-09-16T06:46:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 --2- 172.21.15.134:0/2476619386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d0140c60 0x7f88d00a3dc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 -- 172.21.15.134:0/2476619386 >> 172.21.15.134:0/2476619386 conn(0x7f88d006de60 msgr2=0x7f88d0072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 -- 172.21.15.134:0/2476619386 shutdown_connections 2024-09-16T06:46:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 -- 172.21.15.134:0/2476619386 wait complete. 2024-09-16T06:46:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 Processor -- start 2024-09-16T06:46:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.336+0000 7f88d6312640 1 -- start start 2024-09-16T06:46:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d00a5310 0x7f88d014a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88d0141040 0x7f88d00a7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88d00a6c90 0x7f88d01defd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00a88c0 con 0x7f88d0141040 2024-09-16T06:46:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d00b6c40 con 0x7f88d00a5310 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d014c870 con 0x7f88d00a6c90 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d00a5310 0x7f88d014a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d00a5310 0x7f88d014a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55394/0 (socket says 172.21.15.134:55394) 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 -- 172.21.15.134:0/3820192027 learned_addr learned my addr 172.21.15.134:0/3820192027 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d48af640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88d00a6c90 0x7f88d01defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cf7fe640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88d0141040 0x7f88d00a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 -- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88d00a6c90 msgr2=0x7f88d01defd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88d00a6c90 0x7f88d01defd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 -- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88d0141040 msgr2=0x7f88d00a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88d0141040 0x7f88d00a7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 -- 172.21.15.134:0/3820192027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c0009420 con 0x7f88d00a5310 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88cffff640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d00a5310 0x7f88d014a290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88c0019f90 tx=0x7f88c0019100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 1 -- 172.21.15.134:0/3820192027 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00b4610 con 0x7f88d00a5310 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 1 -- 172.21.15.134:0/3820192027 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00b4790 con 0x7f88d00a5310 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 1 -- 172.21.15.134:0/3820192027 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00b4b40 con 0x7f88d00a5310 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d014acf0 con 0x7f88d00a5310 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d014ccc0 con 0x7f88d00a5310 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 1 -- 172.21.15.134:0/3820192027 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f88c00b2040 con 0x7f88d00a5310 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 20 mgrc handle_mgr_map mgrmap(e 1) v1 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 4 mgrc handle_mgr_map Got map version 1 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88ccff9640 1 -- 172.21.15.134:0/3820192027 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f88c00bf770 con 0x7f88d00a5310 2024-09-16T06:46:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.340+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d014b210 con 0x7f88d00a5310 2024-09-16T06:46:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.344+0000 7f88ccff9640 1 -- 172.21.15.134:0/3820192027 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f88d014b210 con 0x7f88d00a5310 2024-09-16T06:46:16.409 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.412+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "955450ea-68e9-4215-985b-ce7892e1f2d8", "id": 1} v 0) v1 -- 0x7f88d00a3dc0 con 0x7f88d00a5310 2024-09-16T06:46:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88ccff9640 1 -- 172.21.15.134:0/3820192027 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "955450ea-68e9-4215-985b-ce7892e1f2d8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f88c00b0070 con 0x7f88d00a5310 2024-09-16T06:46:16.415 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 10 mgrc shutdown 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d00a5310 msgr2=0x7f88d014a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d00a5310 0x7f88d014a290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88c0019f90 tx=0x7f88c0019100 comp rx=0 tx=0).stop 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 shutdown_connections 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88d0141040 0x7f88d00a7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f88d00a6c90 0x7f88d01defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 --2- 172.21.15.134:0/3820192027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88d00a5310 0x7f88d014a290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 >> 172.21.15.134:0/3820192027 conn(0x7f88d006de60 msgr2=0x7f88d0142820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 shutdown_connections 2024-09-16T06:46:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.416+0000 7f88d6312640 1 -- 172.21.15.134:0/3820192027 wait complete. 2024-09-16T06:46:16.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 895d4d4e-f52e-4d47-99c5-63471daf0b7f 2 2024-09-16T06:46:16.458 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:16.455+0000 7fa6a7388180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:46:16.492 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:16.492+0000 7f60a6e9c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:46:16.538 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:16.540+0000 7f90d42e6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:46:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e7252b640 1 Processor -- start 2024-09-16T06:46:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e7252b640 1 -- start start 2024-09-16T06:46:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e7252b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c1368a0 0x7f2e6c0a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e7252b640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2e6c0a5090 0x7f2e6c0a7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e7252b640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c0a5c50 con 0x7f2e6c0a5870 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e7252b640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c0a8c90 con 0x7f2e6c0a5090 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e7252b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1446a0 con 0x7f2e6c1368a0 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e70ac8640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2e6c0a5090 0x7f2e6c0a7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e6bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2e6c0a5870 0x7f2e6c143f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33230/0 (socket says 172.21.15.134:33230) 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e6bfff640 1 -- 172.21.15.134:0/1607215436 learned_addr learned my addr 172.21.15.134:0/1607215436 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e6b7fe640 1 --2- 172.21.15.134:0/1607215436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c1368a0 0x7f2e6c0a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e70ac8640 1 -- 172.21.15.134:0/1607215436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c1368a0 msgr2=0x7f2e6c0a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e6affd640 1 -- 172.21.15.134:0/1607215436 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136827866 0 0) 0x7f2e6c0a5c50 con 0x7f2e6c0a5870 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e70ac8640 1 --2- 172.21.15.134:0/1607215436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c1368a0 0x7f2e6c0a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e70ac8640 1 -- 172.21.15.134:0/1607215436 >> v1:172.21.15.134:6789/0 conn(0x7f2e6c0a5870 legacy=0x7f2e6c143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.548+0000 7f2e70ac8640 1 -- 172.21.15.134:0/1607215436 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c143780 con 0x7f2e6c0a5090 2024-09-16T06:46:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e70ac8640 1 --2- 172.21.15.134:0/1607215436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c0a5090 0x7f2e6c0a7e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400bfa0 tx=0x7f2e6401eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e33e2a167f9e078 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e6affd640 1 -- 172.21.15.134:0/1607215436 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400b2d0 con 0x7f2e6c0a5090 2024-09-16T06:46:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e6affd640 1 -- 172.21.15.134:0/1607215436 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640a7870 con 0x7f2e6c0a5090 2024-09-16T06:46:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e6affd640 1 -- 172.21.15.134:0/1607215436 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640a7c00 con 0x7f2e6c0a5090 2024-09-16T06:46:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 -- 172.21.15.134:0/1607215436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c0a5090 msgr2=0x7f2e6c0a7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 --2- 172.21.15.134:0/1607215436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c0a5090 0x7f2e6c0a7e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400bfa0 tx=0x7f2e6401eac0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 -- 172.21.15.134:0/1607215436 shutdown_connections 2024-09-16T06:46:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 --2- 172.21.15.134:0/1607215436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c0a5090 0x7f2e6c0a7e10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 --2- 172.21.15.134:0/1607215436 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c1368a0 0x7f2e6c0a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 -- 172.21.15.134:0/1607215436 >> 172.21.15.134:0/1607215436 conn(0x7f2e6c06de60 msgr2=0x7f2e6c072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 -- 172.21.15.134:0/1607215436 shutdown_connections 2024-09-16T06:46:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.552+0000 7f2e7252b640 1 -- 172.21.15.134:0/1607215436 wait complete. 2024-09-16T06:46:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 Processor -- start 2024-09-16T06:46:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 -- start start 2024-09-16T06:46:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0a5090 0x7f2e6c12df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c0a5870 0x7f2e6c12cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c1368a0 0x7f2e6c1daa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c12d820 con 0x7f2e6c0a5090 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c14a8a0 con 0x7f2e6c1368a0 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c12e580 con 0x7f2e6c0a5870 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c1368a0 0x7f2e6c1daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c1368a0 0x7f2e6c1daa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55412/0 (socket says 172.21.15.134:55412) 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 -- 172.21.15.134:0/1717036844 learned_addr learned my addr 172.21.15.134:0/1717036844 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e6b7fe640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c0a5870 0x7f2e6c12cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e6bfff640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0a5090 0x7f2e6c12df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 -- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c0a5870 msgr2=0x7f2e6c12cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c0a5870 0x7f2e6c12cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 -- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0a5090 msgr2=0x7f2e6c12df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0a5090 0x7f2e6c12df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 -- 172.21.15.134:0/1717036844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6400bc80 con 0x7f2e6c1368a0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e70ac8640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c1368a0 0x7f2e6c1daa80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e640b1040 tx=0x7f2e6401b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 1 -- 172.21.15.134:0/1717036844 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64009950 con 0x7f2e6c1368a0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 1 -- 172.21.15.134:0/1717036844 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64009ab0 con 0x7f2e6c1368a0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c12e840 con 0x7f2e6c1368a0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 1 -- 172.21.15.134:0/1717036844 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64009e60 con 0x7f2e6c1368a0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c135b50 con 0x7f2e6c1368a0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 1 -- 172.21.15.134:0/1717036844 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2e640ba770 con 0x7f2e6c1368a0 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 20 mgrc handle_mgr_map mgrmap(e 1) v1 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 4 mgrc handle_mgr_map Got map version 1 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:46:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:46:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.556+0000 7f2e68ff9640 1 -- 172.21.15.134:0/1717036844 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2e640c3a50 con 0x7f2e6c1368a0 2024-09-16T06:46:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.560+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c143f90 con 0x7f2e6c1368a0 2024-09-16T06:46:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.560+0000 7f2e68ff9640 1 -- 172.21.15.134:0/1717036844 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f2e640be020 con 0x7f2e6c1368a0 2024-09-16T06:46:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.628+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "895d4d4e-f52e-4d47-99c5-63471daf0b7f", "id": 2} v 0) v1 -- 0x7f2e6c0b5180 con 0x7f2e6c1368a0 2024-09-16T06:46:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e68ff9640 1 -- 172.21.15.134:0/1717036844 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "895d4d4e-f52e-4d47-99c5-63471daf0b7f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2e640c3cb0 con 0x7f2e6c1368a0 2024-09-16T06:46:16.635 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 10 mgrc shutdown 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c1368a0 msgr2=0x7f2e6c1daa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c1368a0 0x7f2e6c1daa80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e640b1040 tx=0x7f2e6401b860 comp rx=0 tx=0).stop 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 shutdown_connections 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e6c1368a0 0x7f2e6c1daa80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2e6c0a5870 0x7f2e6c12cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 --2- 172.21.15.134:0/1717036844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e6c0a5090 0x7f2e6c12df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 >> 172.21.15.134:0/1717036844 conn(0x7f2e6c06de60 msgr2=0x7f2e6c0a3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 shutdown_connections 2024-09-16T06:46:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.636+0000 7f2e7252b640 1 -- 172.21.15.134:0/1717036844 wait complete. 2024-09-16T06:46:16.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 23b8d56f-269e-401e-bb38-4a980a3def0a 3 2024-09-16T06:46:16.689 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:16.692+0000 7f60a6e9c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:46:16.690 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:16.692+0000 7f90d42e6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:46:16.695 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:16.691+0000 7fa6a7388180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:46:16.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f341a287640 1 Processor -- start 2024-09-16T06:46:16.761 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f341a287640 1 -- start start 2024-09-16T06:46:16.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f341a287640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3414142fc0 0x7f3414072b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.762 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f341a287640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f341414be60 0x7f341414e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f341a287640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341406e820 con 0x7f3414070330 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f341a287640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341406be40 con 0x7f341414be60 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f341a287640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341406f850 con 0x7f3414142fc0 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f3413fff640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3414142fc0 0x7f3414072b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f34137fe640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3414070330 0x7f341406e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:33234/0 (socket says 172.21.15.134:33234) 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f34137fe640 1 -- 172.21.15.134:0/72497209 learned_addr learned my addr 172.21.15.134:0/72497209 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f3418824640 1 --2- 172.21.15.134:0/72497209 >> v2:172.21.15.96:3300/0 conn(0x7f341414be60 0x7f341414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f3413fff640 1 -- 172.21.15.134:0/72497209 >> v2:172.21.15.96:3300/0 conn(0x7f341414be60 msgr2=0x7f341414e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f3413fff640 1 --2- 172.21.15.134:0/72497209 >> v2:172.21.15.96:3300/0 conn(0x7f341414be60 0x7f341414e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f3413fff640 1 -- 172.21.15.134:0/72497209 >> v1:172.21.15.134:6789/0 conn(0x7f3414070330 legacy=0x7f341406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f3413fff640 1 -- 172.21.15.134:0/72497209 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341406fb10 con 0x7f3414142fc0 2024-09-16T06:46:16.763 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.764+0000 7f3412ffd640 1 -- 172.21.15.134:0/72497209 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201390896 0 0) 0x7f341406e820 con 0x7f3414070330 2024-09-16T06:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f3413fff640 1 --2- 172.21.15.134:0/72497209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414072b70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f34140a77d0 tx=0x7f340401c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e03432af0509ebb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f3412ffd640 1 -- 172.21.15.134:0/72497209 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040ab600 con 0x7f3414142fc0 2024-09-16T06:46:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f3412ffd640 1 -- 172.21.15.134:0/72497209 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34040a7050 con 0x7f3414142fc0 2024-09-16T06:46:16.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f3412ffd640 1 -- 172.21.15.134:0/72497209 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040ab980 con 0x7f3414142fc0 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 -- 172.21.15.134:0/72497209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 msgr2=0x7f3414072b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 --2- 172.21.15.134:0/72497209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414072b70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f34140a77d0 tx=0x7f340401c340 comp rx=0 tx=0).stop 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 -- 172.21.15.134:0/72497209 shutdown_connections 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 --2- 172.21.15.134:0/72497209 >> v2:172.21.15.96:3300/0 conn(0x7f341414be60 0x7f341414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 --2- 172.21.15.134:0/72497209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414072b70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 -- 172.21.15.134:0/72497209 >> 172.21.15.134:0/72497209 conn(0x7f34140b6110 msgr2=0x7f34140b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 -- 172.21.15.134:0/72497209 shutdown_connections 2024-09-16T06:46:16.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 -- 172.21.15.134:0/72497209 wait complete. 2024-09-16T06:46:16.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 Processor -- start 2024-09-16T06:46:16.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.768+0000 7f341a287640 1 -- start start 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3414070330 0x7f3414141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f341414be60 0x7f34140aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34140ae5a0 con 0x7f3414070330 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414142680 con 0x7f3414142fc0 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341413c010 con 0x7f341414be60 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.771 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:55430/0 (socket says 172.21.15.134:55430) 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 -- 172.21.15.134:0/877531486 learned_addr learned my addr 172.21.15.134:0/877531486 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3413fff640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3414070330 0x7f3414141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 -- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f341414be60 msgr2=0x7f34140aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3418824640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f341414be60 0x7f34140aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f341414be60 0x7f34140aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 -- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3414070330 msgr2=0x7f3414141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3414070330 0x7f3414141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 -- 172.21.15.134:0/877531486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3404009420 con 0x7f3414142fc0 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f34137fe640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414147e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34080011f0 tx=0x7f340800c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 1 -- 172.21.15.134:0/877531486 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34080074e0 con 0x7f3414142fc0 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 1 -- 172.21.15.134:0/877531486 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408007640 con 0x7f3414142fc0 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 1 -- 172.21.15.134:0/877531486 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408004a10 con 0x7f3414142fc0 2024-09-16T06:46:16.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34141484b0 con 0x7f3414142fc0 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34140addc0 con 0x7f3414142fc0 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 1 -- 172.21.15.134:0/877531486 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3408012400 con 0x7f3414142fc0 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 20 mgrc handle_mgr_map mgrmap(e 1) v1 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 4 mgrc handle_mgr_map Got map version 1 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f3410ff9640 1 -- 172.21.15.134:0/877531486 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f340801b7f0 con 0x7f3414142fc0 2024-09-16T06:46:16.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.772+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34140a81b0 con 0x7f3414142fc0 2024-09-16T06:46:16.774 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.776+0000 7f3410ff9640 1 -- 172.21.15.134:0/877531486 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3408018070 con 0x7f3414142fc0 2024-09-16T06:46:16.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.844+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23b8d56f-269e-401e-bb38-4a980a3def0a", "id": 3} v 0) v1 -- 0x7f3414072b70 con 0x7f3414142fc0 2024-09-16T06:46:16.849 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f3410ff9640 1 -- 172.21.15.134:0/877531486 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23b8d56f-269e-401e-bb38-4a980a3def0a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f340801b4d0 con 0x7f3414142fc0 2024-09-16T06:46:16.849 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-09-16T06:46:16.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 10 mgrc shutdown 2024-09-16T06:46:16.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 msgr2=0x7f3414147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:16.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414147e40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f34080011f0 tx=0x7f340800c9b0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 shutdown_connections 2024-09-16T06:46:16.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f341414be60 0x7f34140aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.851 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3414142fc0 0x7f3414147e40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 --2- 172.21.15.134:0/877531486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3414070330 0x7f3414141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:16.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 >> 172.21.15.134:0/877531486 conn(0x7f34140b6110 msgr2=0x7f34140a5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:16.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 shutdown_connections 2024-09-16T06:46:16.852 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T06:46:16.852+0000 7f341a287640 1 -- 172.21.15.134:0/877531486 wait complete. 2024-09-16T06:46:16.865 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T06:46:16.866 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T06:46:16.868 INFO:tasks.ceph.osd.0:Started 2024-09-16T06:46:16.868 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T06:46:16.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T06:46:16.910 INFO:tasks.ceph.osd.1:Started 2024-09-16T06:46:16.910 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T06:46:16.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T06:46:16.912 INFO:tasks.ceph.osd.2:Started 2024-09-16T06:46:16.912 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T06:46:16.912 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T06:46:16.914 INFO:tasks.ceph.osd.3:Started 2024-09-16T06:46:16.914 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:17.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.035+0000 7ff37e0f7640 1 Processor -- start 2024-09-16T06:46:17.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.035+0000 7ff37e0f7640 1 -- start start 2024-09-16T06:46:17.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff37e0f7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff378070a70 0x7ff37806f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff37e0f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff378070ec0 0x7ff37814aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff37e0f7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff378144690 con 0x7ff3780a5da0 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff37e0f7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff378143ba0 con 0x7ff378070a70 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff37e0f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff378143e60 con 0x7ff378070ec0 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff3777fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff3780a5da0 0x7ff37806b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52758/0 (socket says 172.21.15.96:52758) 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff3777fe640 1 -- 172.21.15.96:0/3156805135 learned_addr learned my addr 172.21.15.96:0/3156805135 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff377fff640 1 --2- 172.21.15.96:0/3156805135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff378070ec0 0x7ff37814aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff376ffd640 1 --2- 172.21.15.96:0/3156805135 >> v2:172.21.15.134:3300/0 conn(0x7ff378070a70 0x7ff37806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff3767fc640 1 -- 172.21.15.96:0/3156805135 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188296563 0 0) 0x7ff378144690 con 0x7ff3780a5da0 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff3767fc640 1 -- 172.21.15.96:0/3156805135 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff364005740 con 0x7ff3780a5da0 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff377fff640 1 -- 172.21.15.96:0/3156805135 >> v2:172.21.15.134:3300/0 conn(0x7ff378070a70 msgr2=0x7ff37806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff377fff640 1 --2- 172.21.15.96:0/3156805135 >> v2:172.21.15.134:3300/0 conn(0x7ff378070a70 0x7ff37806f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff377fff640 1 -- 172.21.15.96:0/3156805135 >> v1:172.21.15.96:6789/0 conn(0x7ff3780a5da0 legacy=0x7ff37806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.043 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.039+0000 7ff377fff640 1 -- 172.21.15.96:0/3156805135 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37806f7d0 con 0x7ff378070ec0 2024-09-16T06:46:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 --2- 172.21.15.96:0/3156805135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff378070ec0 0x7ff37814aaf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c5f74df2c679cde server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff3767fc640 1 -- 172.21.15.96:0/3156805135 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700a5710 con 0x7ff378070ec0 2024-09-16T06:46:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff3767fc640 1 -- 172.21.15.96:0/3156805135 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3700a5870 con 0x7ff378070ec0 2024-09-16T06:46:17.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff3767fc640 1 -- 172.21.15.96:0/3156805135 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700a5c00 con 0x7ff378070ec0 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- 172.21.15.96:0/3156805135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff378070ec0 msgr2=0x7ff37814aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 --2- 172.21.15.96:0/3156805135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff378070ec0 0x7ff37814aaf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37001c950 comp rx=0 tx=0).stop 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- 172.21.15.96:0/3156805135 shutdown_connections 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 --2- 172.21.15.96:0/3156805135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff378070ec0 0x7ff37814aaf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 --2- 172.21.15.96:0/3156805135 >> v2:172.21.15.134:3300/0 conn(0x7ff378070a70 0x7ff37806f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- 172.21.15.96:0/3156805135 >> 172.21.15.96:0/3156805135 conn(0x7ff378072f70 msgr2=0x7ff3780b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- 172.21.15.96:0/3156805135 shutdown_connections 2024-09-16T06:46:17.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- 172.21.15.96:0/3156805135 wait complete. 2024-09-16T06:46:17.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 Processor -- start 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- start start 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff378070a70 0x7ff3780af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff378070ec0 0x7ff378098ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3780a5da0 0x7ff3780b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780b0890 con 0x7ff378070ec0 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781db230 con 0x7ff378070a70 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff37e0f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780aff20 con 0x7ff3780a5da0 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3780a5da0 0x7ff3780b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff376ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff378070ec0 0x7ff378098ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3780a5da0 0x7ff3780b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:57920/0 (socket says 172.21.15.96:57920) 2024-09-16T06:46:17.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 -- 172.21.15.96:0/2928649263 learned_addr learned my addr 172.21.15.96:0/2928649263 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff3777fe640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff378070a70 0x7ff3780af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 -- 172.21.15.96:0/2928649263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff378070a70 msgr2=0x7ff3780af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff378070a70 0x7ff3780af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 -- 172.21.15.96:0/2928649263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff378070ec0 msgr2=0x7ff378098ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff378070ec0 0x7ff378098ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.043+0000 7ff377fff640 1 -- 172.21.15.96:0/2928649263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370009a70 con 0x7ff3780a5da0 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff377fff640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3780a5da0 0x7ff3780b5210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3700b0040 tx=0x7ff3700196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:17.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 1 -- 172.21.15.96:0/2928649263 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700b9650 con 0x7ff3780a5da0 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 1 -- 172.21.15.96:0/2928649263 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3700b97b0 con 0x7ff3780a5da0 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3780b01e0 con 0x7ff3780a5da0 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 1 -- 172.21.15.96:0/2928649263 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700b9b60 con 0x7ff3780a5da0 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3780b31a0 con 0x7ff3780a5da0 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 1 -- 172.21.15.96:0/2928649263 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff3700ad440 con 0x7ff3780a5da0 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 20 mgrc handle_mgr_map mgrmap(e 1) v1 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 4 mgrc handle_mgr_map Got map version 1 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:46:17.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 1 -- 172.21.15.96:0/2928649263 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff3700c2910 con 0x7ff3780a5da0 2024-09-16T06:46:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3780b33f0 con 0x7ff3780a5da0 2024-09-16T06:46:17.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.047+0000 7ff36ffff640 1 -- 172.21.15.96:0/2928649263 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff3780b33f0 con 0x7ff3780a5da0 2024-09-16T06:46:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff37806f290 con 0x7ff3780a5da0 2024-09-16T06:46:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff36ffff640 1 -- 172.21.15.96:0/2928649263 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7ff3700bd020 con 0x7ff3780a5da0 2024-09-16T06:46:17.110 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:17.110 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":6,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:16.843452+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 10 mgrc shutdown 2024-09-16T06:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3780a5da0 msgr2=0x7ff3780b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3780a5da0 0x7ff3780b5210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3700b0040 tx=0x7ff3700196f0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 shutdown_connections 2024-09-16T06:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff378070ec0 0x7ff378098ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff3780a5da0 0x7ff3780b5210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 --2- 172.21.15.96:0/2928649263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff378070a70 0x7ff3780af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 >> 172.21.15.96:0/2928649263 conn(0x7ff378072f70 msgr2=0x7ff37806dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 shutdown_connections 2024-09-16T06:46:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:17.107+0000 7ff37e0f7640 1 -- 172.21.15.96:0/2928649263 wait complete. 2024-09-16T06:46:17.126 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T06:46:17.126 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T06:46:17.288 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.283+0000 7fa6a7388180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:46:17.303 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.304+0000 7f90d42e6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:46:17.303 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.304+0000 7f60a6e9c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:46:17.341 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.339+0000 7fa6a7388180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:46:17.358 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.360+0000 7f90d42e6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:46:17.358 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.360+0000 7f60a6e9c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:46:17.393 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.391+0000 7fa6a7388180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:46:17.411 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.412+0000 7f60a6e9c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:46:17.411 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.412+0000 7f90d42e6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:46:17.469 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.467+0000 7fa6a7388180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:46:17.478 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-16T06:46:17.475+0000 7fc87e8aa7c0 -1 Falling back to public interface 2024-09-16T06:46:17.489 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.492+0000 7f60a6e9c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:46:17.490 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.492+0000 7f90d42e6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:46:17.521 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.519+0000 7fa6a7388180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:46:17.530 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:17.534 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-16T06:46:17.536+0000 7f2c58c657c0 -1 Falling back to public interface 2024-09-16T06:46:17.542 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.544+0000 7f90d42e6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:46:17.543 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.544+0000 7f60a6e9c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:46:17.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-16T06:46:17.552+0000 7f1bdf5487c0 -1 Falling back to public interface 2024-09-16T06:46:17.549 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-16T06:46:17.552+0000 7fc3a33e47c0 -1 Falling back to public interface 2024-09-16T06:46:17.600 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.595+0000 7fa6a7388180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:46:17.623 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.624+0000 7f90d42e6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:46:17.624 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.624+0000 7f60a6e9c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:46:17.640 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.635+0000 7f3b7c74f640 1 Processor -- start 2024-09-16T06:46:17.641 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.635+0000 7f3b7c74f640 1 -- start start 2024-09-16T06:46:17.642 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7c74f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b740ab810 0x7f3b740713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.642 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7c74f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b740ac970 0x7f3b740b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.642 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7c74f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740707e0 0x7f3b7413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.642 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7c74f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b740ace80 con 0x7f3b740ac970 2024-09-16T06:46:17.642 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7c74f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b740ad140 con 0x7f3b740ab810 2024-09-16T06:46:17.642 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7c74f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740b7c30 con 0x7f3b740707e0 2024-09-16T06:46:17.642 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b79cea640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b740ac970 0x7f3b740b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740707e0 0x7f3b7413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740707e0 0x7f3b7413e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:57936/0 (socket says 172.21.15.96:57936) 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b79cea640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b740ac970 0x7f3b740b76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58988/0 (socket says 172.21.15.96:58988) 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 -- 172.21.15.96:0/3663853102 learned_addr learned my addr 172.21.15.96:0/3663853102 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7a4eb640 1 --2- 172.21.15.96:0/3663853102 >> v2:172.21.15.134:3300/0 conn(0x7f3b740ab810 0x7f3b740713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 -- 172.21.15.96:0/3663853102 >> v2:172.21.15.134:3300/0 conn(0x7f3b740ab810 msgr2=0x7f3b740713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 --2- 172.21.15.96:0/3663853102 >> v2:172.21.15.134:3300/0 conn(0x7f3b740ab810 0x7f3b740713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 -- 172.21.15.96:0/3663853102 >> v2:172.21.15.96:3300/0 conn(0x7f3b740ac970 msgr2=0x7f3b740b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 --2- 172.21.15.96:0/3663853102 >> v2:172.21.15.96:3300/0 conn(0x7f3b740ac970 0x7f3b740b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 -- 172.21.15.96:0/3663853102 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740abbf0 con 0x7f3b740707e0 2024-09-16T06:46:17.643 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b79cea640 1 --2- 172.21.15.96:0/3663853102 >> v2:172.21.15.96:3300/0 conn(0x7f3b740ac970 0x7f3b740b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:17.644 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b7acec640 1 --2- 172.21.15.96:0/3663853102 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740707e0 0x7f3b7413e3e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b740aa4c0 tx=0x7f3b6c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27cf862b33a57590 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:17.644 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b794e9640 1 -- 172.21.15.96:0/3663853102 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0a5640 con 0x7f3b740707e0 2024-09-16T06:46:17.644 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b794e9640 1 -- 172.21.15.96:0/3663853102 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0a57a0 con 0x7f3b740707e0 2024-09-16T06:46:17.644 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.639+0000 7f3b794e9640 1 -- 172.21.15.96:0/3663853102 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0a5b30 con 0x7f3b740707e0 2024-09-16T06:46:17.645 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- 172.21.15.96:0/3663853102 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740707e0 msgr2=0x7f3b7413e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.645 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/3663853102 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740707e0 0x7f3b7413e3e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b740aa4c0 tx=0x7f3b6c01c8b0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.645 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- 172.21.15.96:0/3663853102 shutdown_connections 2024-09-16T06:46:17.645 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/3663853102 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740707e0 0x7f3b7413e3e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.645 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/3663853102 >> v2:172.21.15.96:3300/0 conn(0x7f3b740ac970 0x7f3b740b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.645 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/3663853102 >> v2:172.21.15.134:3300/0 conn(0x7f3b740ab810 0x7f3b740713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.645 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- 172.21.15.96:0/3663853102 >> 172.21.15.96:0/3663853102 conn(0x7f3b7406afc0 msgr2=0x7f3b74072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:17.646 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- 172.21.15.96:0/3663853102 shutdown_connections 2024-09-16T06:46:17.646 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- 172.21.15.96:0/3663853102 wait complete. 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 Processor -- start 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- start start 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b740707e0 0x7f3b740afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740ab810 0x7f3b741d9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b740ac970 0x7f3b740adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b741d94d0 con 0x7f3b740707e0 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740aeea0 con 0x7f3b740ac970 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740af180 con 0x7f3b740ab810 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740ab810 0x7f3b741d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7a4eb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b740707e0 0x7f3b740afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740ab810 0x7f3b741d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:57950/0 (socket says 172.21.15.96:57950) 2024-09-16T06:46:17.648 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 -- 172.21.15.96:0/1518648887 learned_addr learned my addr 172.21.15.96:0/1518648887 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7acec640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b740ac970 0x7f3b740adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 -- 172.21.15.96:0/1518648887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b740ac970 msgr2=0x7f3b740adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b740ac970 0x7f3b740adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 -- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b740707e0 msgr2=0x7f3b740afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b740707e0 0x7f3b740afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 -- 172.21.15.96:0/1518648887 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009420 con 0x7f3b740ab810 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7a4eb640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b740707e0 0x7f3b740afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b79cea640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740ab810 0x7f3b741d9790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e980 tx=0x7f3b6400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 1 -- 172.21.15.96:0/1518648887 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400ca00 con 0x7f3b740ab810 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 1 -- 172.21.15.96:0/1518648887 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400cb60 con 0x7f3b740ab810 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 1 -- 172.21.15.96:0/1518648887 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64013470 con 0x7f3b740ab810 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c009b30 con 0x7f3b740ab810 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b740aff50 con 0x7f3b740ab810 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 1 -- 172.21.15.96:0/1518648887 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3b64005ca0 con 0x7f3b740ab810 2024-09-16T06:46:17.649 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 20 mgrc handle_mgr_map mgrmap(e 1) v1 2024-09-16T06:46:17.650 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 4 mgrc handle_mgr_map Got map version 1 2024-09-16T06:46:17.650 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:46:17.650 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:46:17.650 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.643+0000 7f3b6affd640 1 -- 172.21.15.96:0/1518648887 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3b64006840 con 0x7f3b740ab810 2024-09-16T06:46:17.650 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.647+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b74067290 con 0x7f3b740ab810 2024-09-16T06:46:17.651 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.647+0000 7f3b6affd640 1 -- 172.21.15.96:0/1518648887 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3b64021060 con 0x7f3b740ab810 2024-09-16T06:46:17.657 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.655+0000 7fa6a7388180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:46:17.677 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.680+0000 7f90d42e6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:46:17.677 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.680+0000 7f60a6e9c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:46:17.718 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b740713f0 con 0x7f3b740ab810 2024-09-16T06:46:17.719 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b6affd640 1 -- 172.21.15.96:0/1518648887 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f3b64017070 con 0x7f3b740ab810 2024-09-16T06:46:17.719 INFO:teuthology.misc.health.smithi096.stdout: 2024-09-16T06:46:17.719 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":6,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:16.843452+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:17.720 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 10 mgrc shutdown 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740ab810 msgr2=0x7f3b741d9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740ab810 0x7f3b741d9790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e980 tx=0x7f3b6400ee40 comp rx=0 tx=0).stop 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 shutdown_connections 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b740ac970 0x7f3b740adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3b740ab810 0x7f3b741d9790 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 --2- 172.21.15.96:0/1518648887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b740707e0 0x7f3b740afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 >> 172.21.15.96:0/1518648887 conn(0x7f3b7406afc0 msgr2=0x7f3b74072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.715+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 shutdown_connections 2024-09-16T06:46:17.721 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:17.719+0000 7f3b7c74f640 1 -- 172.21.15.96:0/1518648887 wait complete. 2024-09-16T06:46:17.734 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T06:46:17.828 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.823+0000 7fa6a7388180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:46:17.831 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.832+0000 7f90d42e6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:46:17.831 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.832+0000 7f60a6e9c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:46:17.891 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:17.887+0000 7fa6a7388180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:46:17.892 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:17.892+0000 7f60a6e9c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:46:17.893 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:17.892+0000 7f90d42e6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:46:18.565 INFO:tasks.ceph.mgr.y.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:46:18.565 INFO:tasks.ceph.mgr.y.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:46:18.566 INFO:tasks.ceph.mgr.y.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:46:18.566 INFO:tasks.ceph.mgr.z.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:46:18.566 INFO:tasks.ceph.mgr.z.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:46:18.566 INFO:tasks.ceph.mgr.z.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:46:18.646 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:18.648+0000 7f60a6e9c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:46:18.646 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:18.648+0000 7f90d42e6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:46:18.690 INFO:tasks.ceph.mgr.x.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:46:18.690 INFO:tasks.ceph.mgr.x.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:46:18.690 INFO:tasks.ceph.mgr.x.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:46:18.736 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:18.731+0000 7fa6a7388180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:46:18.823 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:18.824+0000 7f90d42e6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:46:18.832 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:18.832+0000 7f60a6e9c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:46:18.875 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:18.871+0000 7fa6a7388180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:46:18.992 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:18.992+0000 7f90d42e6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:46:18.993 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:18.996+0000 7f60a6e9c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:46:19.036 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:19.031+0000 7fa6a7388180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:46:19.057 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:19.060+0000 7f90d42e6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:46:19.059 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:19.060+0000 7f60a6e9c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:46:19.093 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:46:19.096 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:46:19.098 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:19.095+0000 7fa6a7388180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:46:19.195 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:19.196+0000 7f90d42e6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:46:19.202 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:19.204+0000 7f60a6e9c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:46:19.233 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:19.231+0000 7fa6a7388180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:46:19.806 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:19.808+0000 7f60a6e9c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:46:19.839 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:19.835+0000 7fa6a7388180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:46:19.859 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:19.860+0000 7f90d42e6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:46:19.881 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:19.884+0000 7f60a6e9c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:46:19.914 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:19.911+0000 7fa6a7388180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:46:19.935 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:19.936+0000 7f90d42e6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:46:20.066 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:20.068+0000 7f60a6e9c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:46:20.080 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:20.080+0000 7f90d42e6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:46:20.091 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:20.087+0000 7fa6a7388180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:46:20.141 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:20.144+0000 7f60a6e9c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:46:20.154 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:20.156+0000 7f90d42e6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:46:20.164 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:20.159+0000 7fa6a7388180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:46:20.443 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:20.444+0000 7f90d42e6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:46:20.444 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:20.444+0000 7f60a6e9c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:46:20.450 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:20.447+0000 7fa6a7388180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:46:20.506 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:46:20.508+0000 7f90d42e6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:46:20.507 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:20.508+0000 7f60a6e9c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:46:20.516 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:46:20.511+0000 7fa6a7388180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:46:21.257 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-16T06:46:21.255+0000 7fc87e8aa7c0 -1 osd.0 0 log_to_monitors true 2024-09-16T06:46:21.360 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-16T06:46:21.360+0000 7f2c58c657c0 -1 osd.3 0 log_to_monitors true 2024-09-16T06:46:21.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-16T06:46:21.404+0000 7f1bdf5487c0 -1 osd.1 0 log_to_monitors true 2024-09-16T06:46:21.459 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-16T06:46:21.460+0000 7fc3a33e47c0 -1 osd.2 0 log_to_monitors true 2024-09-16T06:46:21.540 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:21.540+0000 7f604e351640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-16T06:46:21.540 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:46:21.540+0000 7f604e351640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-16T06:46:24.138 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:24.252 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.247+0000 7fbce8907640 1 Processor -- start 2024-09-16T06:46:24.252 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.247+0000 7fbce8907640 1 -- start start 2024-09-16T06:46:24.253 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbce40ab810 0x7fbce40713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:24.253 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40707e0 0x7fbce413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:24.253 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce40ace80 con 0x7fbce40ac970 2024-09-16T06:46:24.253 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40ad140 con 0x7fbce40ab810 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40abbf0 con 0x7fbce40707e0 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40707e0 0x7fbce413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbce40ab810 0x7fbce40713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbce40ab810 0x7fbce40713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57010/0 (socket says 172.21.15.96:57010) 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 -- 172.21.15.96:0/113661611 learned_addr learned my addr 172.21.15.96:0/113661611 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40707e0 0x7fbce413e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:59132/0 (socket says 172.21.15.96:59132) 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 -- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40707e0 msgr2=0x7fbce413e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 --2- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40707e0 0x7fbce413e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 -- 172.21.15.96:0/113661611 >> v1:172.21.15.134:6789/0 conn(0x7fbce40ac970 legacy=0x7fbce40b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 -- 172.21.15.96:0/113661611 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce413e920 con 0x7fbce40ab810 2024-09-16T06:46:24.254 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce2d9d640 1 --2- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40707e0 0x7fbce413e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:24.255 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce259c640 1 --2- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40ab810 0x7fbce40713f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009870 tx=0x7fbcd401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e492849f0e6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:24.255 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce1d9b640 1 -- 172.21.15.96:0/113661611 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40ab600 con 0x7fbce40ab810 2024-09-16T06:46:24.256 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce1d9b640 1 -- 172.21.15.96:0/113661611 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40a7050 con 0x7fbce40ab810 2024-09-16T06:46:24.256 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce1d9b640 1 -- 172.21.15.96:0/113661611 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40ab980 con 0x7fbce40ab810 2024-09-16T06:46:24.256 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40ab810 msgr2=0x7fbce40713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:24.257 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 --2- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40ab810 0x7fbce40713f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009870 tx=0x7fbcd401c420 comp rx=0 tx=0).stop 2024-09-16T06:46:24.257 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- 172.21.15.96:0/113661611 shutdown_connections 2024-09-16T06:46:24.257 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 --2- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40707e0 0x7fbce413e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.257 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 --2- 172.21.15.96:0/113661611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40ab810 0x7fbce40713f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.257 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- 172.21.15.96:0/113661611 >> 172.21.15.96:0/113661611 conn(0x7fbce406afc0 msgr2=0x7fbce4072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:24.257 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- 172.21.15.96:0/113661611 shutdown_connections 2024-09-16T06:46:24.257 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.251+0000 7fbce8907640 1 -- 172.21.15.96:0/113661611 wait complete. 2024-09-16T06:46:24.258 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 Processor -- start 2024-09-16T06:46:24.258 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 -- start start 2024-09-16T06:46:24.260 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40707e0 0x7fbce4149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:24.260 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce40ab810 0x7fbce406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:24.260 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40ac970 0x7fbce40adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4145540 con 0x7fbce40707e0 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce414a520 con 0x7fbce40ab810 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce414a7e0 con 0x7fbce40ac970 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40707e0 0x7fbce4149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40707e0 0x7fbce4149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57014/0 (socket says 172.21.15.96:57014) 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 -- 172.21.15.96:0/1481014015 learned_addr learned my addr 172.21.15.96:0/1481014015 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce2d9d640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40ac970 0x7fbce40adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbcdbfff640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce40ab810 0x7fbce406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 -- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40ac970 msgr2=0x7fbce40adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40ac970 0x7fbce40adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 -- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce40ab810 msgr2=0x7fbce406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce40ab810 0x7fbce406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.261 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 -- 172.21.15.96:0/1481014015 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009a70 con 0x7fbce40707e0 2024-09-16T06:46:24.262 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce259c640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40707e0 0x7fbce4149e40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40ae040 tx=0x7fbcd40191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:24.262 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbcdaffd640 1 -- 172.21.15.96:0/1481014015 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40b4640 con 0x7fbce40707e0 2024-09-16T06:46:24.262 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbcdaffd640 1 -- 172.21.15.96:0/1481014015 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40b47c0 con 0x7fbce40707e0 2024-09-16T06:46:24.262 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd40094d0 con 0x7fbce40707e0 2024-09-16T06:46:24.262 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbcdaffd640 1 -- 172.21.15.96:0/1481014015 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40b4b70 con 0x7fbce40707e0 2024-09-16T06:46:24.262 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce40a67a0 con 0x7fbce40707e0 2024-09-16T06:46:24.262 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.255+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce4067290 con 0x7fbce40707e0 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdaffd640 1 -- 172.21.15.96:0/1481014015 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 128821+0+0 (secure 0 0 0) 0x7fbcd40b2070 con 0x7fbce40707e0 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdaffd640 20 mgrc handle_mgr_map mgrmap(e 4) v1 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdaffd640 4 mgrc handle_mgr_map Got map version 4 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdaffd640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbcc40977b0 0x7fbcc4099c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdaffd640 1 -- 172.21.15.96:0/1481014015 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7fbcd41594c0 con 0x7fbce40707e0 2024-09-16T06:46:24.263 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdbfff640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbcc40977b0 0x7fbcc4099c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:24.264 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.259+0000 7fbcdbfff640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbcc40977b0 0x7fbcc4099c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbce414ad80 tx=0x7fbccc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:24.266 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.263+0000 7fbcdaffd640 1 -- 172.21.15.96:0/1481014015 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbcd4127750 con 0x7fbce40707e0 2024-09-16T06:46:24.452 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.447+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbce4142340 con 0x7fbce40707e0 2024-09-16T06:46:24.452 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbcdaffd640 1 -- 172.21.15.96:0/1481014015 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4152 (secure 0 0 0) 0x7fbcd40b8090 con 0x7fbce40707e0 2024-09-16T06:46:24.453 INFO:teuthology.misc.health.smithi096.stdout: 2024-09-16T06:46:24.453 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":8,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:22.586040+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:24.455 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 10 mgrc shutdown 2024-09-16T06:46:24.455 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbcc40977b0 msgr2=0x7fbcc4099c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:24.455 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbcc40977b0 0x7fbcc4099c70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbce414ad80 tx=0x7fbccc009040 comp rx=0 tx=0).stop 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40707e0 msgr2=0x7fbce4149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40707e0 0x7fbce4149e40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40ae040 tx=0x7fbcd40191c0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 shutdown_connections 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbcc40977b0 0x7fbcc4099c70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbce40ac970 0x7fbce40adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce40ab810 0x7fbce406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 --2- 172.21.15.96:0/1481014015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbce40707e0 0x7fbce4149e40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 >> 172.21.15.96:0/1481014015 conn(0x7fbce406afc0 msgr2=0x7fbce4072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 shutdown_connections 2024-09-16T06:46:24.456 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:24.451+0000 7fbce8907640 1 -- 172.21.15.96:0/1481014015 wait complete. 2024-09-16T06:46:24.469 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T06:46:25.259 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-16T06:46:25.255+0000 7fc87a84f640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T06:46:25.290 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-09-16T06:46:25.287+0000 7fc872682640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T06:46:25.512 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-16T06:46:25.512+0000 7f2c54c0a640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T06:46:25.537 INFO:tasks.ceph.osd.3.smithi134.stderr:2024-09-16T06:46:25.540+0000 7f2c4ca3d640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T06:46:25.548 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-16T06:46:25.552+0000 7fc39f389640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T06:46:25.577 INFO:tasks.ceph.osd.2.smithi134.stderr:2024-09-16T06:46:25.580+0000 7fc3971bc640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T06:46:25.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-16T06:46:25.600+0000 7f1bdbd04640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T06:46:25.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-09-16T06:46:25.640+0000 7f1bd3320640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T06:46:30.873 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:30.996 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.991+0000 7f9f12242640 1 Processor -- start 2024-09-16T06:46:30.996 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.991+0000 7f9f12242640 1 -- start start 2024-09-16T06:46:31.003 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c0b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.003 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f0c14bd10 0x7f9f0c14e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.003 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c143330 con 0x7f9f0c142840 2024-09-16T06:46:31.003 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c071400 con 0x7f9f0c14bd10 2024-09-16T06:46:31.003 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c06db80 con 0x7f9f0c06fe60 2024-09-16T06:46:31.003 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c0b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c0b76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:59144/0 (socket says 172.21.15.96:59144) 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/1485695224 learned_addr learned my addr 172.21.15.96:0/1485695224 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/1485695224 >> v2:172.21.15.134:3300/0 conn(0x7f9f0c14bd10 msgr2=0x7f9f0c14e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 --2- 172.21.15.96:0/1485695224 >> v2:172.21.15.134:3300/0 conn(0x7f9f0c14bd10 0x7f9f0c14e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/1485695224 >> v1:172.21.15.134:6789/0 conn(0x7f9f0c142840 legacy=0x7f9f0c142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/1485695224 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0716a0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0b7fe640 1 --2- 172.21.15.96:0/1485695224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c0b76a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009e50 tx=0x7f9efc01c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=274ed4f633c41cba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0a7fc640 1 -- 172.21.15.96:0/1485695224 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0a5660 con 0x7f9f0c06fe60 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0a7fc640 1 -- 172.21.15.96:0/1485695224 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc0a57c0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f0a7fc640 1 -- 172.21.15.96:0/1485695224 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0a5b50 con 0x7f9f0c06fe60 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- 172.21.15.96:0/1485695224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 msgr2=0x7f9f0c0b76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.004 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 --2- 172.21.15.96:0/1485695224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c0b76a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009e50 tx=0x7f9efc01c880 comp rx=0 tx=0).stop 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- 172.21.15.96:0/1485695224 shutdown_connections 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 --2- 172.21.15.96:0/1485695224 >> v2:172.21.15.134:3300/0 conn(0x7f9f0c14bd10 0x7f9f0c14e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 --2- 172.21.15.96:0/1485695224 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c0b76a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- 172.21.15.96:0/1485695224 >> 172.21.15.96:0/1485695224 conn(0x7f9f0c06afc0 msgr2=0x7f9f0c072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- 172.21.15.96:0/1485695224 shutdown_connections 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.995+0000 7f9f12242640 1 -- 172.21.15.96:0/1485695224 wait complete. 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 Processor -- start 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 -- start start 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c1def40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f0c142840 0x7f9f0c1df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f0c14bd10 0x7f9f0c149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c14aca0 con 0x7f9f0c14bd10 2024-09-16T06:46:31.005 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c145d10 con 0x7f9f0c142840 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c14a3c0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c1def40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c1def40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:59148/0 (socket says 172.21.15.96:59148) 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/4145353207 learned_addr learned my addr 172.21.15.96:0/4145353207 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0bfff640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f0c14bd10 0x7f9f0c149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f0c142840 msgr2=0x7f9f0c1df480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0affd640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f0c142840 0x7f9f0c1df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f0c142840 0x7f9f0c1df480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f0c14bd10 msgr2=0x7f9f0c149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f0c14bd10 0x7f9f0c149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 -- 172.21.15.96:0/4145353207 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009b30 con 0x7f9f0c06fe60 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0affd640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f0c142840 0x7f9f0c1df480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:31.006 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f0b7fe640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c1def40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9efc01af30 tx=0x7f9efc019620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.007 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f03fff640 1 -- 172.21.15.96:0/4145353207 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0b8670 con 0x7f9f0c06fe60 2024-09-16T06:46:31.007 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f03fff640 1 -- 172.21.15.96:0/4145353207 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc0b87d0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.007 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c1473a0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.007 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f03fff640 1 -- 172.21.15.96:0/4145353207 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0b8b80 con 0x7f9f0c06fe60 2024-09-16T06:46:31.007 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c1df9c0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:30.999+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c067290 con 0x7f9f0c06fe60 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f03fff640 1 -- 172.21.15.96:0/4145353207 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 4) v1 ==== 128821+0+0 (secure 0 0 0) 0x7f9efc0b8ce0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f03fff640 20 mgrc handle_mgr_map mgrmap(e 4) v1 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f03fff640 4 mgrc handle_mgr_map Got map version 4 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f03fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f03fff640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9eec0977e0 0x7f9eec099ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f03fff640 1 -- 172.21.15.96:0/4145353207 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f9efc15b190 con 0x7f9f0c06fe60 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f0affd640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9eec0977e0 0x7f9eec099ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.008 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.003+0000 7f9f0affd640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9eec0977e0 0x7f9eec099ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c13b660 tx=0x7f9ef4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.009 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.007+0000 7f9f03fff640 1 -- 172.21.15.96:0/4145353207 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9efc128ee0 con 0x7f9f0c06fe60 2024-09-16T06:46:31.166 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.163+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f0c14af10 con 0x7f9f0c06fe60 2024-09-16T06:46:31.167 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.163+0000 7f9f03fff640 1 -- 172.21.15.96:0/4145353207 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7941 (secure 0 0 0) 0x7f9efc12c500 con 0x7f9f0c06fe60 2024-09-16T06:46:31.168 INFO:teuthology.misc.health.smithi096.stdout: 2024-09-16T06:46:31.168 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":12,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:29.269974+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:31.170 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 10 mgrc shutdown 2024-09-16T06:46:31.170 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9eec0977e0 msgr2=0x7f9eec099ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.170 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9eec0977e0 0x7f9eec099ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c13b660 tx=0x7f9ef4009040 comp rx=0 tx=0).stop 2024-09-16T06:46:31.171 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 msgr2=0x7f9f0c1def40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.171 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c1def40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9efc01af30 tx=0x7f9efc019620 comp rx=0 tx=0).stop 2024-09-16T06:46:31.171 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 shutdown_connections 2024-09-16T06:46:31.171 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9eec0977e0 0x7f9eec099ca0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.171 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f0c14bd10 0x7f9f0c149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.172 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f0c142840 0x7f9f0c1df480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.172 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 --2- 172.21.15.96:0/4145353207 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f0c06fe60 0x7f9f0c1def40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.172 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 >> 172.21.15.96:0/4145353207 conn(0x7f9f0c06afc0 msgr2=0x7f9f0c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:31.172 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 shutdown_connections 2024-09-16T06:46:31.172 INFO:teuthology.misc.health.smithi096.stderr:2024-09-16T06:46:31.167+0000 7f9f12242640 1 -- 172.21.15.96:0/4145353207 wait complete. 2024-09-16T06:46:31.185 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T06:46:31.185 INFO:tasks.ceph:Creating RBD pool 2024-09-16T06:46:31.185 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T06:46:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb6a1bbd640 1 Processor -- start 2024-09-16T06:46:31.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb6a1bbd640 1 -- start start 2024-09-16T06:46:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb6a1bbd640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb69c06d700 0x7fb69c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb6a1bbd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c1453d0 0x7fb69c14c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb6a1bbd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c06a320 con 0x7fb69c069f40 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb6a1bbd640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c06db30 con 0x7fb69c06d700 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb6a1bbd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c06ad00 con 0x7fb69c1453d0 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c1453d0 0x7fb69c14c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c1453d0 0x7fb69c14c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:59150/0 (socket says 172.21.15.96:59150) 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69bfff640 1 -- 172.21.15.96:0/1216813869 learned_addr learned my addr 172.21.15.96:0/1216813869 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69b7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb69c069f40 0x7fb69c144cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47136/0 (socket says 172.21.15.96:47136) 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69affd640 1 --2- 172.21.15.96:0/1216813869 >> v2:172.21.15.134:3300/0 conn(0x7fb69c06d700 0x7fb69c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69bfff640 1 -- 172.21.15.96:0/1216813869 >> v2:172.21.15.134:3300/0 conn(0x7fb69c06d700 msgr2=0x7fb69c06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69bfff640 1 --2- 172.21.15.96:0/1216813869 >> v2:172.21.15.134:3300/0 conn(0x7fb69c06d700 0x7fb69c06a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69bfff640 1 -- 172.21.15.96:0/1216813869 >> v1:172.21.15.96:6789/0 conn(0x7fb69c069f40 legacy=0x7fb69c144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.299+0000 7fb69bfff640 1 -- 172.21.15.96:0/1216813869 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c06e840 con 0x7fb69c1453d0 2024-09-16T06:46:31.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69bfff640 1 --2- 172.21.15.96:0/1216813869 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c1453d0 0x7fb69c14c200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb694009e50 tx=0x7fb69401c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3715baf08af1d6d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69a7fc640 1 -- 172.21.15.96:0/1216813869 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6940a57d0 con 0x7fb69c1453d0 2024-09-16T06:46:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69a7fc640 1 -- 172.21.15.96:0/1216813869 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6940a5930 con 0x7fb69c1453d0 2024-09-16T06:46:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69a7fc640 1 -- 172.21.15.96:0/1216813869 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6940a5cc0 con 0x7fb69c1453d0 2024-09-16T06:46:31.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/1216813869 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c1453d0 msgr2=0x7fb69c14c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/1216813869 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c1453d0 0x7fb69c14c200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb694009e50 tx=0x7fb69401c8f0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/1216813869 shutdown_connections 2024-09-16T06:46:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/1216813869 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c1453d0 0x7fb69c14c200 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/1216813869 >> v2:172.21.15.134:3300/0 conn(0x7fb69c06d700 0x7fb69c06a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/1216813869 >> 172.21.15.96:0/1216813869 conn(0x7fb69c0a4520 msgr2=0x7fb69c0a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/1216813869 shutdown_connections 2024-09-16T06:46:31.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/1216813869 wait complete. 2024-09-16T06:46:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 Processor -- start 2024-09-16T06:46:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- start start 2024-09-16T06:46:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c069f40 0x7fb69c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c06d700 0x7fb69c141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c1453d0 0x7fb69c142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c142840 con 0x7fb69c06d700 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c148900 con 0x7fb69c1453d0 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb6a1bbd640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c142a50 con 0x7fb69c069f40 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c069f40 0x7fb69c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c06d700 0x7fb69c141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c06d700 0x7fb69c141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57044/0 (socket says 172.21.15.96:57044) 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c069f40 0x7fb69c149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:59164/0 (socket says 172.21.15.96:59164) 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69affd640 1 -- 172.21.15.96:0/2679829178 learned_addr learned my addr 172.21.15.96:0/2679829178 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69bfff640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c1453d0 0x7fb69c142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.303+0000 7fb69affd640 1 -- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c069f40 msgr2=0x7fb69c149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69affd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c069f40 0x7fb69c149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69affd640 1 -- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c1453d0 msgr2=0x7fb69c142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69affd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c1453d0 0x7fb69c142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69affd640 1 -- 172.21.15.96:0/2679829178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb694009b30 con 0x7fb69c06d700 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69b7fe640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c069f40 0x7fb69c149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69bfff640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c1453d0 0x7fb69c142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69affd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c06d700 0x7fb69c141dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb69000d800 tx=0x7fb69000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000b6c0 con 0x7fb69c06d700 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69000b820 con 0x7fb69c06d700 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c142d10 con 0x7fb69c06d700 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000bb90 con 0x7fb69c06d700 2024-09-16T06:46:31.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c149550 con 0x7fb69c06d700 2024-09-16T06:46:31.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c06a5d0 con 0x7fb69c06d700 2024-09-16T06:46:31.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 128821+0+0 (secure 0 0 0) 0x7fb69000bcf0 con 0x7fb69c06d700 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 20 mgrc handle_mgr_map mgrmap(e 4) v1 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 4 mgrc handle_mgr_map Got map version 4 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb6880977b0 0x7fb688099c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7fb6900c06a0 con 0x7fb69c06d700 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.307+0000 7fb69b7fe640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb6880977b0 0x7fb688099c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.311+0000 7fb69b7fe640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb6880977b0 0x7fb688099c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb68c000f70 tx=0x7fb68c007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.311+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb69008e3f0 con 0x7fb69c06d700 2024-09-16T06:46:31.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.471+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb69c149740 con 0x7fb69c06d700 2024-09-16T06:46:31.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.531+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fb69008e7c0 con 0x7fb69c06d700 2024-09-16T06:46:31.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.531+0000 7fb683fff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.531+0000 7fb683fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:31.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.531+0000 7fb683fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:31.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.567+0000 7fb683fff640 1 -- 172.21.15.96:0/2679829178 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb690087d50 con 0x7fb69c06d700 2024-09-16T06:46:31.573 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'rbd' created 2024-09-16T06:46:31.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 10 mgrc shutdown 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb6880977b0 msgr2=0x7fb688099c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb6880977b0 0x7fb688099c70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb68c000f70 tx=0x7fb68c007e50 comp rx=0 tx=0).stop 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c06d700 msgr2=0x7fb69c141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c06d700 0x7fb69c141dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb69000d800 tx=0x7fb69000dcc0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 shutdown_connections 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb6880977b0 0x7fb688099c70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb69c06d700 0x7fb69c141dc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb69c1453d0 0x7fb69c142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 --2- 172.21.15.96:0/2679829178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb69c069f40 0x7fb69c149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 >> 172.21.15.96:0/2679829178 conn(0x7fb69c0a4520 msgr2=0x7fb69c0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:31.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 shutdown_connections 2024-09-16T06:46:31.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.571+0000 7fb6a1bbd640 1 -- 172.21.15.96:0/2679829178 wait complete. 2024-09-16T06:46:31.594 DEBUG:teuthology.orchestra.run.smithi096:> rbd --cluster ceph pool init rbd 2024-09-16T06:46:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e516e00 1 Processor -- start 2024-09-16T06:46:31.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e516e00 1 -- start start 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e516e00 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c209a62420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e516e00 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55c209848ab0 con 0x55c209a465f0 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e516e00 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x55c2098219c0 con 0x55c209994d30 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e516e00 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c20988b370 con 0x55c209995160 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e293640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c209a62420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774d031640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x55c209a465f0 0x55c2099c0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47146/0 (socket says 172.21.15.96:47146) 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774d031640 1 -- 172.21.15.96:0/2833505160 learned_addr learned my addr 172.21.15.96:0/2833505160 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:31.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f773ffff640 1 -- 172.21.15.96:0/2833505160 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219872914 0 0) 0x55c209848ab0 con 0x55c209a465f0 2024-09-16T06:46:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e293640 1 -- 172.21.15.96:0/2833505160 >> v1:172.21.15.134:6789/0 conn(0x55c209994d30 legacy=0x55c2099bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e293640 1 -- 172.21.15.96:0/2833505160 >> v1:172.21.15.96:6789/0 conn(0x55c209a465f0 legacy=0x55c2099c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e293640 1 -- 172.21.15.96:0/2833505160 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c20982e910 con 0x55c209995160 2024-09-16T06:46:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.631+0000 7f774e293640 1 --2- 172.21.15.96:0/2833505160 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c209a62420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f774800a4d0 tx=0x7f774801b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9181d73500aab51e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f773ffff640 1 -- 172.21.15.96:0/2833505160 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77480aa640 con 0x55c209995160 2024-09-16T06:46:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f773ffff640 1 -- 172.21.15.96:0/2833505160 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77480a6070 con 0x55c209995160 2024-09-16T06:46:31.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f773ffff640 1 -- 172.21.15.96:0/2833505160 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77480aa9a0 con 0x55c209995160 2024-09-16T06:46:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- 172.21.15.96:0/2833505160 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 msgr2=0x55c209a62420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 --2- 172.21.15.96:0/2833505160 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c209a62420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f774800a4d0 tx=0x7f774801b420 comp rx=0 tx=0).stop 2024-09-16T06:46:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- 172.21.15.96:0/2833505160 shutdown_connections 2024-09-16T06:46:31.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 --2- 172.21.15.96:0/2833505160 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c209a62420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- 172.21.15.96:0/2833505160 >> 172.21.15.96:0/2833505160 conn(0x55c20999cb40 msgr2=0x55c20999cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- 172.21.15.96:0/2833505160 shutdown_connections 2024-09-16T06:46:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- 172.21.15.96:0/2833505160 wait complete. 2024-09-16T06:46:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 Processor -- start 2024-09-16T06:46:31.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- start start 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c209994d30 0x55c209a3fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c2099cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c209a465f0 0x55c2099cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c209888940 con 0x55c209994d30 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c209884230 con 0x55c209a465f0 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c20981f9b0 con 0x55c209995160 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c209994d30 0x55c209a3fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774c830640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c2099cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c209994d30 0x55c209a3fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57052/0 (socket says 172.21.15.96:57052) 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 -- 172.21.15.96:0/3976878865 learned_addr learned my addr 172.21.15.96:0/3976878865 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:31.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774c830640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c2099cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:59186/0 (socket says 172.21.15.96:59186) 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e293640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c209a465f0 0x55c2099cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 -- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 msgr2=0x55c2099cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c2099cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 -- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c209a465f0 msgr2=0x55c2099cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c209a465f0 0x55c2099cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774800a100 con 0x55c209994d30 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e293640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c209a465f0 0x55c2099cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774c830640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x55c209995160 0x55c2099cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774d031640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c209994d30 0x55c209a3fc20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f774000bdb0 tx=0x7f7740009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740014030 con 0x55c209994d30 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740009e90 con 0x55c209994d30 2024-09-16T06:46:31.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c209821d50 con 0x55c209994d30 2024-09-16T06:46:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000f880 con 0x55c209994d30 2024-09-16T06:46:31.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.635+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2098217b0 con 0x55c209994d30 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f7740017070 con 0x55c209994d30 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f773d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f773d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f773d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f773d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f773d7fa640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7730096130 0x7f77300985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f7740015070 con 0x55c209994d30 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) v1 -- 0x55c209a57600 con 0x55c209994d30 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f774c830640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7730096130 0x7f77300985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:31.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:31.639+0000 7f774c830640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7730096130 0x7f77300985f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x55c2099be5f0 tx=0x7f7744001820 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:32.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.575+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 141+0+0 (secure 0 0 0) 0x7f774008beb0 con 0x55c209994d30 2024-09-16T06:46:32.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.575+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55c209849650 con 0x55c209994d30 2024-09-16T06:46:32.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.575+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7740001990 con 0x55c209994d30 2024-09-16T06:46:32.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.575+0000 7f773f7fe640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=14}) v3 -- 0x7f7728002af0 con 0x55c209994d30 2024-09-16T06:46:32.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.579+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 650+0+0 (secure 0 0 0) 0x7f7740090300 con 0x55c209994d30 2024-09-16T06:46:32.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.579+0000 7f774e516e00 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x55c209a461c0 0x55c209a56040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:32.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.579+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) v8 -- 0x55c2099cc700 con 0x55c209a461c0 2024-09-16T06:46:32.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.579+0000 7f774e293640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x55c209a461c0 0x55c209a56040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:32.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.579+0000 7f774e293640 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x55c209a461c0 0x55c209a56040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:32.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.591+0000 7f774e293640 1 -- 172.21.15.96:0/3976878865 <== osd.0 v2:172.21.15.96:6800/3062669068 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) v8 ==== 153+0+0 (crc 0 0 0) 0x7f77480b0020 con 0x55c209a461c0 2024-09-16T06:46:32.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.595+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) v8 -- 0x55c209ac4220 con 0x55c209a461c0 2024-09-16T06:46:32.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.595+0000 7f774e293640 1 -- 172.21.15.96:0/3976878865 <== osd.0 v2:172.21.15.96:6800/3062669068 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77480b0020 con 0x55c209a461c0 2024-09-16T06:46:32.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.595+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) v8 -- 0x55c209ac3300 con 0x55c209a461c0 2024-09-16T06:46:32.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.595+0000 7f774e293640 1 -- 172.21.15.96:0/3976878865 <== osd.0 v2:172.21.15.96:6800/3062669068 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77480b0020 con 0x55c209a461c0 2024-09-16T06:46:32.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:32.595+0000 7f773effd640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) v4 -- 0x7f772c001f30 con 0x55c209994d30 2024-09-16T06:46:33.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:33.575+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v15) v1 ==== 55+0+0 (secure 0 0 0) 0x7f774008dde0 con 0x55c209994d30 2024-09-16T06:46:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:33.575+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=15}) v3 -- 0x7f773009bb70 con 0x55c209994d30 2024-09-16T06:46:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:33.579+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 10 ==== osd_map(15..15 src has 1..15) v4 ==== 626+0+0 (secure 0 0 0) 0x7f774008fc00 con 0x55c209994d30 2024-09-16T06:46:33.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:33.579+0000 7f773f7fe640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x7f7728005610 con 0x55c209a461c0 2024-09-16T06:46:33.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:33.583+0000 7f774e293640 1 -- 172.21.15.96:0/3976878865 <== osd.0 v2:172.21.15.96:6800/3062669068 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f77480b0020 con 0x55c209a461c0 2024-09-16T06:46:33.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:33.583+0000 7f773effd640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) v4 -- 0x7f772c0033b0 con 0x55c209994d30 2024-09-16T06:46:34.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.587+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v16) v1 ==== 43+0+0 (secure 0 0 0) 0x7f77400ab030 con 0x55c209994d30 2024-09-16T06:46:34.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.587+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=16}) v3 -- 0x7f773009bb70 con 0x55c209994d30 2024-09-16T06:46:34.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.587+0000 7f773d7fa640 1 -- 172.21.15.96:0/3976878865 <== mon.0 v2:172.21.15.96:3300/0 12 ==== osd_map(16..16 src has 1..16) v4 ==== 654+0+0 (secure 0 0 0) 0x7f7740093a30 con 0x55c209994d30 2024-09-16T06:46:34.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.587+0000 7f773f7fe640 1 -- 172.21.15.96:0/3976878865 --> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x7f7728005a00 con 0x55c209a461c0 2024-09-16T06:46:34.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.591+0000 7f774e293640 1 -- 172.21.15.96:0/3976878865 <== osd.0 v2:172.21.15.96:6800/3062669068 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f77480b0020 con 0x55c209a461c0 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.591+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x55c209a461c0 msgr2=0x55c209a56040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.591+0000 7f774e516e00 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x55c209a461c0 0x55c209a56040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.591+0000 7f774e516e00 10 mgrc shutdown 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.591+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7730096130 msgr2=0x7f77300985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.591+0000 7f774e516e00 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7730096130 0x7f77300985f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x55c2099be5f0 tx=0x7f7744001820 comp rx=0 tx=0).stop 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.591+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c209994d30 msgr2=0x55c209a3fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.595+0000 7f774e516e00 1 --2- 172.21.15.96:0/3976878865 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55c209994d30 0x55c209a3fc20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f774000bdb0 tx=0x7f7740009570 comp rx=0 tx=0).stop 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.595+0000 7f774e293640 1 -- 172.21.15.96:0/3976878865 reap_dead start 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.595+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 shutdown_connections 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.595+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 >> 172.21.15.96:0/3976878865 conn(0x55c20999cb40 msgr2=0x55c2099baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.595+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 shutdown_connections 2024-09-16T06:46:34.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.595+0000 7f774e516e00 1 -- 172.21.15.96:0/3976878865 wait complete. 2024-09-16T06:46:34.608 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T06:46:34.609 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T06:46:34.609 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T06:46:34.654 INFO:tasks.ceph.mds.a:Started 2024-09-16T06:46:34.655 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T06:46:34.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T06:46:34.657 INFO:tasks.ceph.mds.c:Started 2024-09-16T06:46:34.657 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T06:46:34.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T06:46:34.660 INFO:tasks.ceph.mds.b:Started 2024-09-16T06:46:34.660 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-16T06:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:34.734 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-09-16T06:46:34.735 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-09-16T06:46:34.756 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-09-16T06:46:34.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f83454d8640 1 Processor -- start 2024-09-16T06:46:34.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f83454d8640 1 -- start start 2024-09-16T06:46:34.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f83454d8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83401378f0 0x7f834006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f83454d8640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83400aa220 con 0x7f83401453e0 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f83454d8640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8340144c00 con 0x7f8340149da0 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f83454d8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400a81e0 con 0x7f83401378f0 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f833e7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83401378f0 0x7f834006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f833effd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f83401453e0 0x7f83400a9a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36192/0 (socket says 172.21.15.96:36192) 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.787+0000 7f833effd640 1 -- 172.21.15.96:0/4195470829 learned_addr learned my addr 172.21.15.96:0/4195470829 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833dffb640 1 -- 172.21.15.96:0/4195470829 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007508320 0 0) 0x7f83400aa220 con 0x7f83401453e0 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833dffb640 1 -- 172.21.15.96:0/4195470829 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f832c003530 con 0x7f83401453e0 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833e7fc640 1 -- 172.21.15.96:0/4195470829 >> v1:172.21.15.134:6789/0 conn(0x7f8340149da0 legacy=0x7f834014c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833e7fc640 1 -- 172.21.15.96:0/4195470829 >> v1:172.21.15.96:6789/0 conn(0x7f83401453e0 legacy=0x7f83400a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833e7fc640 1 -- 172.21.15.96:0/4195470829 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400b6c50 con 0x7f83401378f0 2024-09-16T06:46:34.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833e7fc640 1 --2- 172.21.15.96:0/4195470829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83401378f0 0x7f834006b4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f83300097f0 tx=0x7f833001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf46bdcf7d96dddf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:34.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833dffb640 1 -- 172.21.15.96:0/4195470829 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300ab600 con 0x7f83401378f0 2024-09-16T06:46:34.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833dffb640 1 -- 172.21.15.96:0/4195470829 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83300a7050 con 0x7f83401378f0 2024-09-16T06:46:34.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f833dffb640 1 -- 172.21.15.96:0/4195470829 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300ab960 con 0x7f83401378f0 2024-09-16T06:46:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f83454d8640 1 -- 172.21.15.96:0/4195470829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83401378f0 msgr2=0x7f834006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f83454d8640 1 --2- 172.21.15.96:0/4195470829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83401378f0 0x7f834006b4a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f83300097f0 tx=0x7f833001c430 comp rx=0 tx=0).stop 2024-09-16T06:46:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f83454d8640 1 -- 172.21.15.96:0/4195470829 shutdown_connections 2024-09-16T06:46:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f83454d8640 1 --2- 172.21.15.96:0/4195470829 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f83401378f0 0x7f834006b4a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f83454d8640 1 -- 172.21.15.96:0/4195470829 >> 172.21.15.96:0/4195470829 conn(0x7f8340072f70 msgr2=0x7f83400b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f83454d8640 1 -- 172.21.15.96:0/4195470829 shutdown_connections 2024-09-16T06:46:34.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.791+0000 7f83454d8640 1 -- 172.21.15.96:0/4195470829 wait complete. 2024-09-16T06:46:34.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 Processor -- start 2024-09-16T06:46:34.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 -- start start 2024-09-16T06:46:34.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83401378f0 0x7f83401484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83401453e0 0x7f83400a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8340149da0 0x7f83400a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400a45a0 con 0x7f83401453e0 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400a42d0 con 0x7f83401378f0 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400a2c20 con 0x7f8340149da0 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833e7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83401453e0 0x7f83400a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833f7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8340149da0 0x7f83400a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833e7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83401453e0 0x7f83400a35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35772/0 (socket says 172.21.15.96:35772) 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833e7fc640 1 -- 172.21.15.96:0/2613854601 learned_addr learned my addr 172.21.15.96:0/2613854601 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833effd640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83401378f0 0x7f83401484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833f7fe640 1 -- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83401378f0 msgr2=0x7f83401484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833f7fe640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83401378f0 0x7f83401484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833f7fe640 1 -- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83401453e0 msgr2=0x7f83400a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833f7fe640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83401453e0 0x7f83400a35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833f7fe640 1 -- 172.21.15.96:0/2613854601 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009420 con 0x7f8340149da0 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833e7fc640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83401453e0 0x7f83400a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f833f7fe640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8340149da0 0x7f83400a4860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8340071840 tx=0x7f833800cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83377fe640 1 -- 172.21.15.96:0/2613854601 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338003b80 con 0x7f8340149da0 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83377fe640 1 -- 172.21.15.96:0/2613854601 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338003ce0 con 0x7f8340149da0 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83377fe640 1 -- 172.21.15.96:0/2613854601 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338005310 con 0x7f8340149da0 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400a2f00 con 0x7f8340149da0 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340148a30 con 0x7f8340149da0 2024-09-16T06:46:34.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83400a27a0 con 0x7f8340149da0 2024-09-16T06:46:34.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83377fe640 1 -- 172.21.15.96:0/2613854601 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f8338005680 con 0x7f8340149da0 2024-09-16T06:46:34.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.795+0000 7f83377fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:34.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f83377fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:34.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f83377fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:34.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f83377fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:34.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f83377fe640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8320097870 0x7f8320099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:34.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f83377fe640 1 -- 172.21.15.96:0/2613854601 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f83380c0340 con 0x7f8340149da0 2024-09-16T06:46:34.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f833effd640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8320097870 0x7f8320099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:34.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f833effd640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8320097870 0x7f8320099d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83280011f0 tx=0x7f8328009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:34.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.799+0000 7f83377fe640 1 -- 172.21.15.96:0/2613854601 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f833808de10 con 0x7f8340149da0 2024-09-16T06:46:34.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.959+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83400a3400 con 0x7f8340149da0 2024-09-16T06:46:34.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83377fe640 1 -- 172.21.15.96:0/2613854601 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9783 (secure 0 0 0) 0x7f8338091430 con 0x7f8340149da0 2024-09-16T06:46:34.965 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:34.966 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:34.578172+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 10 mgrc shutdown 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8320097870 msgr2=0x7f8320099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8320097870 0x7f8320099d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f83280011f0 tx=0x7f8328009040 comp rx=0 tx=0).stop 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8340149da0 msgr2=0x7f83400a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8340149da0 0x7f83400a4860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8340071840 tx=0x7f833800cb90 comp rx=0 tx=0).stop 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 shutdown_connections 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8320097870 0x7f8320099d30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83401453e0 0x7f83400a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8340149da0 0x7f83400a4860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 --2- 172.21.15.96:0/2613854601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83401378f0 0x7f83401484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:34.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 >> 172.21.15.96:0/2613854601 conn(0x7f8340072f70 msgr2=0x7f83401495a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:34.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 shutdown_connections 2024-09-16T06:46:34.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:34.963+0000 7f83454d8640 1 -- 172.21.15.96:0/2613854601 wait complete. 2024-09-16T06:46:34.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T06:46:26.589352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-16T06:46:31.515422+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T06:46:34.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T06:46:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61b5bac640 1 Processor -- start 2024-09-16T06:46:35.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61b5bac640 1 -- start start 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61b5bac640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0136b30 0x7f61b006d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61b5bac640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f61b006db60 0x7f61b014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61b5bac640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b00a3970 con 0x7f61b0133610 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61b5bac640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b006e010 con 0x7f61b006db60 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61b5bac640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b00a71b0 con 0x7f61b0136b30 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61affff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f61b006db60 0x7f61b014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.095+0000 7f61aeffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0136b30 0x7f61b006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61aeffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0136b30 0x7f61b006d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40242/0 (socket says 172.21.15.96:40242) 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61aeffd640 1 -- 172.21.15.96:0/1992008279 learned_addr learned my addr 172.21.15.96:0/1992008279 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61affff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f61b006db60 0x7f61b014ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35780/0 (socket says 172.21.15.96:35780) 2024-09-16T06:46:35.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61aeffd640 1 -- 172.21.15.96:0/1992008279 >> v2:172.21.15.96:3300/0 conn(0x7f61b006db60 msgr2=0x7f61b014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61aeffd640 1 --2- 172.21.15.96:0/1992008279 >> v2:172.21.15.96:3300/0 conn(0x7f61b006db60 0x7f61b014ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61aeffd640 1 -- 172.21.15.96:0/1992008279 >> v1:172.21.15.134:6789/0 conn(0x7f61b0133610 legacy=0x7f61b00a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61aeffd640 1 -- 172.21.15.96:0/1992008279 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0132e60 con 0x7f61b0136b30 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61aeffd640 1 --2- 172.21.15.96:0/1992008279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0136b30 0x7f61b006d620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c48e96e0486f96db server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61ae7fc640 1 -- 172.21.15.96:0/1992008279 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40ab600 con 0x7f61b0136b30 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61ae7fc640 1 -- 172.21.15.96:0/1992008279 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40a7050 con 0x7f61b0136b30 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61ae7fc640 1 -- 172.21.15.96:0/1992008279 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40ab980 con 0x7f61b0136b30 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 -- 172.21.15.96:0/1992008279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0136b30 msgr2=0x7f61b006d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 --2- 172.21.15.96:0/1992008279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0136b30 0x7f61b006d620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a401c470 comp rx=0 tx=0).stop 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 -- 172.21.15.96:0/1992008279 shutdown_connections 2024-09-16T06:46:35.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 --2- 172.21.15.96:0/1992008279 >> v2:172.21.15.96:3300/0 conn(0x7f61b006db60 0x7f61b014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 --2- 172.21.15.96:0/1992008279 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0136b30 0x7f61b006d620 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 -- 172.21.15.96:0/1992008279 >> 172.21.15.96:0/1992008279 conn(0x7f61b00a4520 msgr2=0x7f61b00a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 -- 172.21.15.96:0/1992008279 shutdown_connections 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.099+0000 7f61b5bac640 1 -- 172.21.15.96:0/1992008279 wait complete. 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 Processor -- start 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 -- start start 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61b006db60 0x7f61b0143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0133610 0x7f61b01dbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b0136b30 0x7f61b01dc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b012bb70 con 0x7f61b006db60 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b012d050 con 0x7f61b0136b30 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01dfa90 con 0x7f61b0133610 2024-09-16T06:46:35.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0133610 0x7f61b01dbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61af7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61b006db60 0x7f61b0143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0133610 0x7f61b01dbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40250/0 (socket says 172.21.15.96:40250) 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61af7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61b006db60 0x7f61b0143db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35794/0 (socket says 172.21.15.96:35794) 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 -- 172.21.15.96:0/3239256176 learned_addr learned my addr 172.21.15.96:0/3239256176 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 -- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b0136b30 msgr2=0x7f61b01dc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b0136b30 0x7f61b01dc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 -- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61b006db60 msgr2=0x7f61b0143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61b006db60 0x7f61b0143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 -- 172.21.15.96:0/3239256176 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40094d0 con 0x7f61b0133610 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61af7fe640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61b006db60 0x7f61b0143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61aeffd640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0133610 0x7f61b01dbed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f61a401cd10 tx=0x7f61a4019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f6197fff640 1 -- 172.21.15.96:0/3239256176 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40b6440 con 0x7f61b0133610 2024-09-16T06:46:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f6197fff640 1 -- 172.21.15.96:0/3239256176 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40b65c0 con 0x7f61b0133610 2024-09-16T06:46:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b006e570 con 0x7f61b0133610 2024-09-16T06:46:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f6197fff640 1 -- 172.21.15.96:0/3239256176 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40b6970 con 0x7f61b0133610 2024-09-16T06:46:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b012cc30 con 0x7f61b0133610 2024-09-16T06:46:35.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b012c440 con 0x7f61b0133610 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f6197fff640 1 -- 172.21.15.96:0/3239256176 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f61a40b2040 con 0x7f61b0133610 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.103+0000 7f6197fff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f6197fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f6197fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f6197fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f6197fff640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f619c097870 0x7f619c099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f6197fff640 1 -- 172.21.15.96:0/3239256176 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f61a415a250 con 0x7f61b0133610 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f61af7fe640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f619c097870 0x7f619c099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f61af7fe640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f619c097870 0x7f619c099d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.107+0000 7f6197fff640 1 -- 172.21.15.96:0/3239256176 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61a4127d20 con 0x7f61b0133610 2024-09-16T06:46:35.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61b012c440 con 0x7f61b0133610 2024-09-16T06:46:35.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f6197fff640 1 -- 172.21.15.96:0/3239256176 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61b012c440 con 0x7f61b0133610 2024-09-16T06:46:35.266 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 10 mgrc shutdown 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f619c097870 msgr2=0x7f619c099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f619c097870 0x7f619c099d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0007e40 comp rx=0 tx=0).stop 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0133610 msgr2=0x7f61b01dbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0133610 0x7f61b01dbed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f61a401cd10 tx=0x7f61a4019210 comp rx=0 tx=0).stop 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 shutdown_connections 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f619c097870 0x7f619c099d30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b0136b30 0x7f61b01dc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f61b0133610 0x7f61b01dbed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 --2- 172.21.15.96:0/3239256176 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61b006db60 0x7f61b0143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 >> 172.21.15.96:0/3239256176 conn(0x7f61b00a4520 msgr2=0x7f61b00a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:35.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 shutdown_connections 2024-09-16T06:46:35.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.263+0000 7f61b5bac640 1 -- 172.21.15.96:0/3239256176 wait complete. 2024-09-16T06:46:35.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-16T06:46:35.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.403+0000 7f3ddd4a3640 1 Processor -- start 2024-09-16T06:46:35.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.403+0000 7f3ddd4a3640 1 -- start start 2024-09-16T06:46:35.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3ddd4a3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3dd80b9de0 0x7f3dd8147300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3ddd4a3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80ba1c0 con 0x7f3dd8147840 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3ddd4a3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd80aa0c0 con 0x7f3dd8139ce0 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3ddd4a3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd8146ba0 con 0x7f3dd80b9de0 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd6ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3dd80b9de0 0x7f3dd8147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd6ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3dd80b9de0 0x7f3dd8147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35804/0 (socket says 172.21.15.96:35804) 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd77fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3dd8147840 0x7f3dd814ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36194/0 (socket says 172.21.15.96:36194) 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/3889652766 learned_addr learned my addr 172.21.15.96:0/3889652766 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/3889652766 >> v1:172.21.15.134:6789/0 conn(0x7f3dd8139ce0 legacy=0x7f3dd80ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/3889652766 >> v1:172.21.15.96:6789/0 conn(0x7f3dd8147840 legacy=0x7f3dd814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/3889652766 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8146d90 con 0x7f3dd80b9de0 2024-09-16T06:46:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd6ffd640 1 --2- 172.21.15.96:0/3889652766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd80b9de0 0x7f3dd8147300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009870 tx=0x7f3dc801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607d03ee5d279803 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd67fc640 1 -- 172.21.15.96:0/3889652766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80a9f40 con 0x7f3dd80b9de0 2024-09-16T06:46:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd67fc640 1 -- 172.21.15.96:0/3889652766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc80ad680 con 0x7f3dd80b9de0 2024-09-16T06:46:35.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.407+0000 7f3dd67fc640 1 -- 172.21.15.96:0/3889652766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80ada10 con 0x7f3dd80b9de0 2024-09-16T06:46:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/3889652766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd80b9de0 msgr2=0x7f3dd8147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/3889652766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd80b9de0 0x7f3dd8147300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009870 tx=0x7f3dc801c430 comp rx=0 tx=0).stop 2024-09-16T06:46:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/3889652766 shutdown_connections 2024-09-16T06:46:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/3889652766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd80b9de0 0x7f3dd8147300 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/3889652766 >> 172.21.15.96:0/3889652766 conn(0x7f3dd8072b70 msgr2=0x7f3dd8072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/3889652766 shutdown_connections 2024-09-16T06:46:35.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/3889652766 wait complete. 2024-09-16T06:46:35.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 Processor -- start 2024-09-16T06:46:35.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- start start 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dd80b9de0 0x7f3dd814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd8139ce0 0x7f3dd8143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd8147840 0x7f3dd8143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80b6be0 con 0x7f3dd8147840 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd814b150 con 0x7f3dd8139ce0 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd814b350 con 0x7f3dd80b9de0 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd8147840 0x7f3dd8143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dd80b9de0 0x7f3dd814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dd80b9de0 0x7f3dd814e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40262/0 (socket says 172.21.15.96:40262) 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/518007078 learned_addr learned my addr 172.21.15.96:0/518007078 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dcffff640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd8139ce0 0x7f3dd8143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd8139ce0 msgr2=0x7f3dd8143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd8139ce0 0x7f3dd8143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd8147840 msgr2=0x7f3dd8143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd8147840 0x7f3dd8143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 -- 172.21.15.96:0/518007078 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc80094d0 con 0x7f3dd80b9de0 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd77fe640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd8147840 0x7f3dd8143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dd6ffd640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dd80b9de0 0x7f3dd814e5b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3dc801a060 tx=0x7f3dc801ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dcf7fe640 1 -- 172.21.15.96:0/518007078 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80bc070 con 0x7f3dd80b9de0 2024-09-16T06:46:35.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dcf7fe640 1 -- 172.21.15.96:0/518007078 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc80b6630 con 0x7f3dd80b9de0 2024-09-16T06:46:35.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd81491c0 con 0x7f3dd80b9de0 2024-09-16T06:46:35.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3dcf7fe640 1 -- 172.21.15.96:0/518007078 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80b69c0 con 0x7f3dd80b9de0 2024-09-16T06:46:35.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.411+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd814d590 con 0x7f3dd80b9de0 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd804eb00 con 0x7f3dd80b9de0 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcf7fe640 1 -- 172.21.15.96:0/518007078 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f3dc80b4070 con 0x7f3dd80b9de0 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcf7fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcf7fe640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3db8097870 0x7f3db8099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcf7fe640 1 -- 172.21.15.96:0/518007078 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f3dc815a680 con 0x7f3dd80b9de0 2024-09-16T06:46:35.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcffff640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3db8097870 0x7f3db8099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.415+0000 7f3dcffff640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3db8097870 0x7f3db8099d30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80a5ee0 tx=0x7f3dc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.419+0000 7f3dcf7fe640 1 -- 172.21.15.96:0/518007078 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3dc8128020 con 0x7f3dd80b9de0 2024-09-16T06:46:35.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.575+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3dd8147300 con 0x7f3dd80b9de0 2024-09-16T06:46:35.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.575+0000 7f3dcf7fe640 1 -- 172.21.15.96:0/518007078 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3dc8129f50 con 0x7f3dd80b9de0 2024-09-16T06:46:35.580 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 10 mgrc shutdown 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3db8097870 msgr2=0x7f3db8099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3db8097870 0x7f3db8099d30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80a5ee0 tx=0x7f3dc0009040 comp rx=0 tx=0).stop 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dd80b9de0 msgr2=0x7f3dd814e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dd80b9de0 0x7f3dd814e5b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3dc801a060 tx=0x7f3dc801ac70 comp rx=0 tx=0).stop 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 shutdown_connections 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3db8097870 0x7f3db8099d30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dd8147840 0x7f3dd8143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dd8139ce0 0x7f3dd8143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 --2- 172.21.15.96:0/518007078 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3dd80b9de0 0x7f3dd814e5b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 >> 172.21.15.96:0/518007078 conn(0x7f3dd8072b70 msgr2=0x7f3dd80b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:35.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 shutdown_connections 2024-09-16T06:46:35.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.579+0000 7f3ddd4a3640 1 -- 172.21.15.96:0/518007078 wait complete. 2024-09-16T06:46:35.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T06:46:35.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.715+0000 7fa69fe76640 1 Processor -- start 2024-09-16T06:46:35.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.715+0000 7fa69fe76640 1 -- start start 2024-09-16T06:46:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69fe76640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6980a3db0 0x7fa69806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69fe76640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698144000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69fe76640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa698143ab0 con 0x7fa69806db60 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69fe76640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69806b020 con 0x7fa6980a3db0 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69fe76640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980a5410 con 0x7fa6980a4190 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69e413640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa69806db60 0x7fa698069ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36200/0 (socket says 172.21.15.96:36200) 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69e413640 1 -- 172.21.15.96:0/3410207104 learned_addr learned my addr 172.21.15.96:0/3410207104 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69d411640 1 --2- 172.21.15.96:0/3410207104 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69dc12640 1 --2- 172.21.15.96:0/3410207104 >> v2:172.21.15.134:3300/0 conn(0x7fa6980a3db0 0x7fa69806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69cc10640 1 -- 172.21.15.96:0/3410207104 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371574491 0 0) 0x7fa698143ab0 con 0x7fa69806db60 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69cc10640 1 -- 172.21.15.96:0/3410207104 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa684003530 con 0x7fa69806db60 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69d411640 1 -- 172.21.15.96:0/3410207104 >> v2:172.21.15.134:3300/0 conn(0x7fa6980a3db0 msgr2=0x7fa69806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:35.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69d411640 1 --2- 172.21.15.96:0/3410207104 >> v2:172.21.15.134:3300/0 conn(0x7fa6980a3db0 0x7fa69806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69d411640 1 -- 172.21.15.96:0/3410207104 >> v1:172.21.15.96:6789/0 conn(0x7fa69806db60 legacy=0x7fa698069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69d411640 1 -- 172.21.15.96:0/3410207104 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6981401b0 con 0x7fa6980a4190 2024-09-16T06:46:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69d411640 1 --2- 172.21.15.96:0/3410207104 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698144000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa68800b870 tx=0x7fa68801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b9b26d95fbbebef server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69cc10640 1 -- 172.21.15.96:0/3410207104 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880a59a0 con 0x7fa6980a4190 2024-09-16T06:46:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69cc10640 1 -- 172.21.15.96:0/3410207104 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6880a5b00 con 0x7fa6980a4190 2024-09-16T06:46:35.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.719+0000 7fa69cc10640 1 -- 172.21.15.96:0/3410207104 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880a5e90 con 0x7fa6980a4190 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/3410207104 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 msgr2=0x7fa698144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 --2- 172.21.15.96:0/3410207104 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698144000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa68800b870 tx=0x7fa68801c940 comp rx=0 tx=0).stop 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/3410207104 shutdown_connections 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 --2- 172.21.15.96:0/3410207104 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698144000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 --2- 172.21.15.96:0/3410207104 >> v2:172.21.15.134:3300/0 conn(0x7fa6980a3db0 0x7fa69806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/3410207104 >> 172.21.15.96:0/3410207104 conn(0x7fa69806b8a0 msgr2=0x7fa6980a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/3410207104 shutdown_connections 2024-09-16T06:46:35.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/3410207104 wait complete. 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 Processor -- start 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- start start 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa69806db60 0x7fa698070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980a3db0 0x7fa698148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa698070bd0 con 0x7fa69806db60 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981480f0 con 0x7fa6980a3db0 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69813c980 con 0x7fa6980a4190 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69dc12640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa69806db60 0x7fa698070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69e413640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69dc12640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa69806db60 0x7fa698070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35816/0 (socket says 172.21.15.96:35816) 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69dc12640 1 -- 172.21.15.96:0/2701647480 learned_addr learned my addr 172.21.15.96:0/2701647480 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69d411640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980a3db0 0x7fa698148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69e413640 1 -- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980a3db0 msgr2=0x7fa698148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69e413640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980a3db0 0x7fa698148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69e413640 1 -- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa69806db60 msgr2=0x7fa698070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69e413640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa69806db60 0x7fa698070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69e413640 1 -- 172.21.15.96:0/2701647480 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68800b4d0 con 0x7fa6980a4190 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69dc12640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa69806db60 0x7fa698070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:35.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69e413640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698148fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa69806df70 tx=0x7fa69000cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa68e7fc640 1 -- 172.21.15.96:0/2701647480 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69000abd0 con 0x7fa6980a4190 2024-09-16T06:46:35.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa68e7fc640 1 -- 172.21.15.96:0/2701647480 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69000ad30 con 0x7fa6980a4190 2024-09-16T06:46:35.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa698144ef0 con 0x7fa6980a4190 2024-09-16T06:46:35.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa68e7fc640 1 -- 172.21.15.96:0/2701647480 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa690012600 con 0x7fa6980a4190 2024-09-16T06:46:35.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa698144200 con 0x7fa6980a4190 2024-09-16T06:46:35.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.723+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa698148230 con 0x7fa6980a4190 2024-09-16T06:46:35.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa68e7fc640 1 -- 172.21.15.96:0/2701647480 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fa690007070 con 0x7fa6980a4190 2024-09-16T06:46:35.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa68e7fc640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:35.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa68e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:35.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa68e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:35.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa68e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:35.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa68e7fc640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa67c0978c0 0x7fa67c099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:35.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa68e7fc640 1 -- 172.21.15.96:0/2701647480 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fa6900bf780 con 0x7fa6980a4190 2024-09-16T06:46:35.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa69dc12640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa67c0978c0 0x7fa67c099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:35.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.727+0000 7fa69dc12640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa67c0978c0 0x7fa67c099d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa69400dfd0 tx=0x7fa69400f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:35.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.731+0000 7fa68e7fc640 1 -- 172.21.15.96:0/2701647480 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa69004bdb0 con 0x7fa6980a4190 2024-09-16T06:46:35.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa69806d620 con 0x7fa6980a4190 2024-09-16T06:46:35.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa68e7fc640 1 -- 172.21.15.96:0/2701647480 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2771 (secure 0 0 0) 0x7fa690017af0 con 0x7fa6980a4190 2024-09-16T06:46:35.914 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:35.914 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6809/2274498401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2274498401},{"type":"v1","addr":"172.21.15.96:6809","nonce":2274498401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6811/2101624097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2101624097},{"type":"v1","addr":"172.21.15.96:6811","nonce":2101624097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4240,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/3093802738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3093802738},{"type":"v1","addr":"172.21.15.134:6827","nonce":3093802738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-16T06:46:35.914 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 3 2024-09-16T06:46:35.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 10 mgrc shutdown 2024-09-16T06:46:35.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa67c0978c0 msgr2=0x7fa67c099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa67c0978c0 0x7fa67c099d80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa69400dfd0 tx=0x7fa69400f040 comp rx=0 tx=0).stop 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 msgr2=0x7fa698148fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698148fa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa69806df70 tx=0x7fa69000cee0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 shutdown_connections 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa67c0978c0 0x7fa67c099d80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa6980a4190 0x7fa698148fa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6980a3db0 0x7fa698148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 --2- 172.21.15.96:0/2701647480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa69806db60 0x7fa698070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 >> 172.21.15.96:0/2701647480 conn(0x7fa69806b8a0 msgr2=0x7fa69814afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 shutdown_connections 2024-09-16T06:46:35.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:35.911+0000 7fa69fe76640 1 -- 172.21.15.96:0/2701647480 wait complete. 2024-09-16T06:46:35.931 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:36.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.047+0000 7f586316d640 1 Processor -- start 2024-09-16T06:46:36.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.047+0000 7f586316d640 1 -- start start 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f586316d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f586316d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f585c139700 0x7f585c147230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f586316d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0ba010 con 0x7f585c0abfb0 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f586316d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0ab720 con 0x7f585c139700 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f586316d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0ab410 con 0x7f585c0b9c30 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40288/0 (socket says 172.21.15.96:40288) 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 -- 172.21.15.96:0/2911208308 learned_addr learned my addr 172.21.15.96:0/2911208308 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f585bfff640 1 --2- 172.21.15.96:0/2911208308 >> v2:172.21.15.134:3300/0 conn(0x7f585c139700 0x7f585c147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 -- 172.21.15.96:0/2911208308 >> v2:172.21.15.134:3300/0 conn(0x7f585c139700 msgr2=0x7f585c147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 --2- 172.21.15.96:0/2911208308 >> v2:172.21.15.134:3300/0 conn(0x7f585c139700 0x7f585c147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 -- 172.21.15.96:0/2911208308 >> v1:172.21.15.134:6789/0 conn(0x7f585c0abfb0 legacy=0x7f585c069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 -- 172.21.15.96:0/2911208308 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c146b50 con 0x7f585c0b9c30 2024-09-16T06:46:36.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f5860f09640 1 --2- 172.21.15.96:0/2911208308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0aaed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f584c0098a0 tx=0x7f584c01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adac46335bbb64b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f585b7fe640 1 -- 172.21.15.96:0/2911208308 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c0a8990 con 0x7f585c0b9c30 2024-09-16T06:46:36.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f585b7fe640 1 -- 172.21.15.96:0/2911208308 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c0a8af0 con 0x7f585c0b9c30 2024-09-16T06:46:36.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.051+0000 7f585b7fe640 1 -- 172.21.15.96:0/2911208308 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c0a8e80 con 0x7f585c0b9c30 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/2911208308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 msgr2=0x7f585c0aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 --2- 172.21.15.96:0/2911208308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0aaed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f584c0098a0 tx=0x7f584c01ecd0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/2911208308 shutdown_connections 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 --2- 172.21.15.96:0/2911208308 >> v2:172.21.15.134:3300/0 conn(0x7f585c139700 0x7f585c147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 --2- 172.21.15.96:0/2911208308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0aaed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/2911208308 >> 172.21.15.96:0/2911208308 conn(0x7f585c06b4a0 msgr2=0x7f585c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/2911208308 shutdown_connections 2024-09-16T06:46:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/2911208308 wait complete. 2024-09-16T06:46:36.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 Processor -- start 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- start start 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0abfb0 0x7f585c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f585c139700 0x7f585c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b3220 con 0x7f585c0abfb0 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c1d86e0 con 0x7f585c139700 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b3430 con 0x7f585c0b9c30 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f5860f09640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0abfb0 0x7f585c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40292/0 (socket says 172.21.15.96:40292) 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 -- 172.21.15.96:0/3121394056 learned_addr learned my addr 172.21.15.96:0/3121394056 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f5860f09640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0abfb0 0x7f585c0a6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35832/0 (socket says 172.21.15.96:35832) 2024-09-16T06:46:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586170a640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f585c139700 0x7f585c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 -- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f585c139700 msgr2=0x7f585c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f585c139700 0x7f585c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 -- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0abfb0 msgr2=0x7f585c0a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0abfb0 0x7f585c0a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 -- 172.21.15.96:0/3121394056 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0094d0 con 0x7f585c0b9c30 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586170a640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f585c139700 0x7f585c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f5860f09640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0abfb0 0x7f585c0a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f585bfff640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0b27a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f585000d5f0 tx=0x7f585000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f58597fa640 1 -- 172.21.15.96:0/3121394056 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500125f0 con 0x7f585c0b9c30 2024-09-16T06:46:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f58597fa640 1 -- 172.21.15.96:0/3121394056 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850012750 con 0x7f585c0b9c30 2024-09-16T06:46:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c071830 con 0x7f585c0b9c30 2024-09-16T06:46:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f58597fa640 1 -- 172.21.15.96:0/3121394056 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850012ae0 con 0x7f585c0b9c30 2024-09-16T06:46:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c0b70a0 con 0x7f585c0b9c30 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.055+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c1476f0 con 0x7f585c0b9c30 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f58597fa640 1 -- 172.21.15.96:0/3121394056 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f5850012c40 con 0x7f585c0b9c30 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f58597fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f58597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f58597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f58597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f58597fa640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5848097840 0x7f5848099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f58597fa640 1 -- 172.21.15.96:0/3121394056 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f58500c0850 con 0x7f585c0b9c30 2024-09-16T06:46:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f5860f09640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5848097840 0x7f5848099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.059+0000 7f5860f09640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5848097840 0x7f5848099d00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f584c0b2000 tx=0x7f584c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.063+0000 7f58597fa640 1 -- 172.21.15.96:0/3121394056 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f585008e320 con 0x7f585c0b9c30 2024-09-16T06:46:36.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.219+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f585c0aaed0 con 0x7f585c0b9c30 2024-09-16T06:46:36.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.219+0000 7f58597fa640 1 -- 172.21.15.96:0/3121394056 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+9783 (secure 0 0 0) 0x7f5850007380 con 0x7f585c0b9c30 2024-09-16T06:46:36.224 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:36.224 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:34.578172+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:36.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 10 mgrc shutdown 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5848097840 msgr2=0x7f5848099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5848097840 0x7f5848099d00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f584c0b2000 tx=0x7f584c009040 comp rx=0 tx=0).stop 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 msgr2=0x7f585c0b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0b27a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f585000d5f0 tx=0x7f585000dab0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 shutdown_connections 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5848097840 0x7f5848099d00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f585c139700 0x7f585c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f585c0b9c30 0x7f585c0b27a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 --2- 172.21.15.96:0/3121394056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f585c0abfb0 0x7f585c0a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 >> 172.21.15.96:0/3121394056 conn(0x7f585c06b4a0 msgr2=0x7f585c06a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 shutdown_connections 2024-09-16T06:46:36.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.223+0000 7f586316d640 1 -- 172.21.15.96:0/3121394056 wait complete. 2024-09-16T06:46:36.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T06:46:26.589352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-16T06:46:31.515422+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T06:46:36.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T06:46:36.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2256799640 1 Processor -- start 2024-09-16T06:46:36.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2256799640 1 -- start start 2024-09-16T06:46:36.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2256799640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f22500b9de0 0x7f2250147300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2256799640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2250147840 0x7f225014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2256799640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500ba1c0 con 0x7f2250139ce0 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2256799640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2250146ba0 con 0x7f2250147840 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2256799640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500aa0c0 con 0x7f22500b9de0 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f22500b9de0 0x7f2250147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f22500b9de0 0x7f2250147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40302/0 (socket says 172.21.15.96:40302) 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 -- 172.21.15.96:0/1161745915 learned_addr learned my addr 172.21.15.96:0/1161745915 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2254d36640 1 --2- 172.21.15.96:0/1161745915 >> v2:172.21.15.134:3300/0 conn(0x7f2250147840 0x7f225014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 -- 172.21.15.96:0/1161745915 >> v2:172.21.15.134:3300/0 conn(0x7f2250147840 msgr2=0x7f225014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 --2- 172.21.15.96:0/1161745915 >> v2:172.21.15.134:3300/0 conn(0x7f2250147840 0x7f225014ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 -- 172.21.15.96:0/1161745915 >> v1:172.21.15.96:6789/0 conn(0x7f2250139ce0 legacy=0x7f22500ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224f7fe640 1 -- 172.21.15.96:0/1161745915 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721077491 0 0) 0x7f22500ba1c0 con 0x7f2250139ce0 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 -- 172.21.15.96:0/1161745915 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250146d90 con 0x7f22500b9de0 2024-09-16T06:46:36.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f2254d36640 1 --2- 172.21.15.96:0/1161745915 >> v2:172.21.15.134:3300/0 conn(0x7f2250147840 0x7f225014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:36.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.367+0000 7f224ffff640 1 --2- 172.21.15.96:0/1161745915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f22500b9de0 0x7f2250147300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2240009870 tx=0x7f224001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f715dccb9c6bee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f224f7fe640 1 -- 172.21.15.96:0/1161745915 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500a9f40 con 0x7f22500b9de0 2024-09-16T06:46:36.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f224f7fe640 1 -- 172.21.15.96:0/1161745915 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22400a7070 con 0x7f22500b9de0 2024-09-16T06:46:36.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f224f7fe640 1 -- 172.21.15.96:0/1161745915 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400ab860 con 0x7f22500b9de0 2024-09-16T06:46:36.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- 172.21.15.96:0/1161745915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f22500b9de0 msgr2=0x7f2250147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 --2- 172.21.15.96:0/1161745915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f22500b9de0 0x7f2250147300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2240009870 tx=0x7f224001c420 comp rx=0 tx=0).stop 2024-09-16T06:46:36.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- 172.21.15.96:0/1161745915 shutdown_connections 2024-09-16T06:46:36.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 --2- 172.21.15.96:0/1161745915 >> v2:172.21.15.134:3300/0 conn(0x7f2250147840 0x7f225014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 --2- 172.21.15.96:0/1161745915 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f22500b9de0 0x7f2250147300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- 172.21.15.96:0/1161745915 >> 172.21.15.96:0/1161745915 conn(0x7f2250072b70 msgr2=0x7f2250072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:36.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- 172.21.15.96:0/1161745915 shutdown_connections 2024-09-16T06:46:36.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- 172.21.15.96:0/1161745915 wait complete. 2024-09-16T06:46:36.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 Processor -- start 2024-09-16T06:46:36.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- start start 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22500b9de0 0x7f22501db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2250139ce0 0x7f225014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2250147840 0x7f225009d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225014d690 con 0x7f2250147840 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22501dbc20 con 0x7f22500b9de0 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22501dbee0 con 0x7f2250139ce0 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2250139ce0 0x7f225014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2254d36640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2250147840 0x7f225009d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2250139ce0 0x7f225014a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40316/0 (socket says 172.21.15.96:40316) 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 -- 172.21.15.96:0/1823177437 learned_addr learned my addr 172.21.15.96:0/1823177437 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f224ffff640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22500b9de0 0x7f22501db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 -- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22500b9de0 msgr2=0x7f22501db410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22500b9de0 0x7f22501db410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 -- 172.21.15.96:0/1823177437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2250147840 msgr2=0x7f225009d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2250147840 0x7f225009d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 -- 172.21.15.96:0/1823177437 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400094d0 con 0x7f2250139ce0 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f22477fe640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2250139ce0 0x7f225014a4a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f223800c520 tx=0x7f223800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f224d7fa640 1 -- 172.21.15.96:0/1823177437 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238003600 con 0x7f2250139ce0 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f224d7fa640 1 -- 172.21.15.96:0/1823177437 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2238003780 con 0x7f2250139ce0 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22501dc1a0 con 0x7f2250139ce0 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f224d7fa640 1 -- 172.21.15.96:0/1823177437 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238003b30 con 0x7f2250139ce0 2024-09-16T06:46:36.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.371+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225014dc10 con 0x7f2250139ce0 2024-09-16T06:46:36.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250147300 con 0x7f2250139ce0 2024-09-16T06:46:36.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224d7fa640 1 -- 172.21.15.96:0/1823177437 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f2238003c90 con 0x7f2250139ce0 2024-09-16T06:46:36.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:36.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:36.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224d7fa640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2230097870 0x7f2230099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224d7fa640 1 -- 172.21.15.96:0/1823177437 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f22380bf3a0 con 0x7f2250139ce0 2024-09-16T06:46:36.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224ffff640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2230097870 0x7f2230099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.375+0000 7f224ffff640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2230097870 0x7f2230099d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22400af000 tx=0x7f22400a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.379+0000 7f224d7fa640 1 -- 172.21.15.96:0/1823177437 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f223808cde0 con 0x7f2250139ce0 2024-09-16T06:46:36.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.527+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22500a7010 con 0x7f2250139ce0 2024-09-16T06:46:36.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.527+0000 7f224d7fa640 1 -- 172.21.15.96:0/1823177437 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2238017070 con 0x7f2250139ce0 2024-09-16T06:46:36.532 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 10 mgrc shutdown 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2230097870 msgr2=0x7f2230099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2230097870 0x7f2230099d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22400af000 tx=0x7f22400a7000 comp rx=0 tx=0).stop 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2250139ce0 msgr2=0x7f225014a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2250139ce0 0x7f225014a4a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f223800c520 tx=0x7f223800c9e0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 shutdown_connections 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2230097870 0x7f2230099d30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2250147840 0x7f225009d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2250139ce0 0x7f225014a4a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 --2- 172.21.15.96:0/1823177437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22500b9de0 0x7f22501db410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 >> 172.21.15.96:0/1823177437 conn(0x7f2250072b70 msgr2=0x7f22500b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:36.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 shutdown_connections 2024-09-16T06:46:36.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.531+0000 7f2256799640 1 -- 172.21.15.96:0/1823177437 wait complete. 2024-09-16T06:46:36.549 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-16T06:46:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.655+0000 7fb49a9e9640 1 Processor -- start 2024-09-16T06:46:36.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.655+0000 7fb49a9e9640 1 -- start start 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb49a9e9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494133610 0x7fb4940a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb49a9e9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4940a6fe0 0x7fb49406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb49a9e9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4940a3970 con 0x7fb494136b30 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb49a9e9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb494132e60 con 0x7fb4940a6fe0 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb49a9e9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb494132b30 con 0x7fb494133610 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494133610 0x7fb4940a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494133610 0x7fb4940a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40324/0 (socket says 172.21.15.96:40324) 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 -- 172.21.15.96:0/760204948 learned_addr learned my addr 172.21.15.96:0/760204948 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb498f86640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb494136b30 0x7fb494069ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36216/0 (socket says 172.21.15.96:36216) 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb4937fe640 1 --2- 172.21.15.96:0/760204948 >> v2:172.21.15.134:3300/0 conn(0x7fb4940a6fe0 0x7fb49406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 -- 172.21.15.96:0/760204948 >> v2:172.21.15.134:3300/0 conn(0x7fb4940a6fe0 msgr2=0x7fb49406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 --2- 172.21.15.96:0/760204948 >> v2:172.21.15.134:3300/0 conn(0x7fb4940a6fe0 0x7fb49406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 -- 172.21.15.96:0/760204948 >> v1:172.21.15.96:6789/0 conn(0x7fb494136b30 legacy=0x7fb494069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 -- 172.21.15.96:0/760204948 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4941339f0 con 0x7fb494133610 2024-09-16T06:46:36.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb4937fe640 1 --2- 172.21.15.96:0/760204948 >> v2:172.21.15.134:3300/0 conn(0x7fb4940a6fe0 0x7fb49406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb493fff640 1 --2- 172.21.15.96:0/760204948 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494133610 0x7fb4940a6aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb48400bb10 tx=0x7fb48401ea10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e090faa51e2c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb492ffd640 1 -- 172.21.15.96:0/760204948 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4840a7820 con 0x7fb494133610 2024-09-16T06:46:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb492ffd640 1 -- 172.21.15.96:0/760204948 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4840a7980 con 0x7fb494133610 2024-09-16T06:46:36.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb492ffd640 1 -- 172.21.15.96:0/760204948 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4840a7d10 con 0x7fb494133610 2024-09-16T06:46:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb49a9e9640 1 -- 172.21.15.96:0/760204948 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494133610 msgr2=0x7fb4940a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.659+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/760204948 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494133610 0x7fb4940a6aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb48400bb10 tx=0x7fb48401ea10 comp rx=0 tx=0).stop 2024-09-16T06:46:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- 172.21.15.96:0/760204948 shutdown_connections 2024-09-16T06:46:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/760204948 >> v2:172.21.15.134:3300/0 conn(0x7fb4940a6fe0 0x7fb49406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/760204948 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494133610 0x7fb4940a6aa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- 172.21.15.96:0/760204948 >> 172.21.15.96:0/760204948 conn(0x7fb4940a4520 msgr2=0x7fb4940a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:36.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- 172.21.15.96:0/760204948 shutdown_connections 2024-09-16T06:46:36.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- 172.21.15.96:0/760204948 wait complete. 2024-09-16T06:46:36.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 Processor -- start 2024-09-16T06:46:36.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- start start 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940a6fe0 0x7fb49406f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb494133610 0x7fb494143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494136b30 0x7fb494144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49406e650 con 0x7fb4940a6fe0 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494070d60 con 0x7fb494133610 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb494070aa0 con 0x7fb494136b30 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb493fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940a6fe0 0x7fb49406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494136b30 0x7fb494144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb493fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940a6fe0 0x7fb49406f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35858/0 (socket says 172.21.15.96:35858) 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494136b30 0x7fb494144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40340/0 (socket says 172.21.15.96:40340) 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb493fff640 1 -- 172.21.15.96:0/336269818 learned_addr learned my addr 172.21.15.96:0/336269818 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 -- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb494133610 msgr2=0x7fb494143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb494133610 0x7fb494143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 -- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940a6fe0 msgr2=0x7fb49406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940a6fe0 0x7fb49406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 -- 172.21.15.96:0/336269818 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48400b770 con 0x7fb494136b30 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb493fff640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940a6fe0 0x7fb49406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb498f86640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494136b30 0x7fb494144300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4940a1f30 tx=0x7fb48c00cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb490ff9640 1 -- 172.21.15.96:0/336269818 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00a640 con 0x7fb494136b30 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb490ff9640 1 -- 172.21.15.96:0/336269818 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00a7a0 con 0x7fb494136b30 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb490ff9640 1 -- 172.21.15.96:0/336269818 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00ab90 con 0x7fb494136b30 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49406f580 con 0x7fb494136b30 2024-09-16T06:46:36.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49413d030 con 0x7fb494136b30 2024-09-16T06:46:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.663+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49406f770 con 0x7fb494136b30 2024-09-16T06:46:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb490ff9640 1 -- 172.21.15.96:0/336269818 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fb48c00acf0 con 0x7fb494136b30 2024-09-16T06:46:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb490ff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb490ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb490ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb490ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb490ff9640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb480097840 0x7fb480099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb490ff9640 1 -- 172.21.15.96:0/336269818 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7fb48c0bf270 con 0x7fb494136b30 2024-09-16T06:46:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb493fff640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb480097840 0x7fb480099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.667+0000 7fb493fff640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb480097840 0x7fb480099d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb48400bb10 tx=0x7fb4840a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.671+0000 7fb490ff9640 1 -- 172.21.15.96:0/336269818 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb48c08cd60 con 0x7fb494136b30 2024-09-16T06:46:36.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.819+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb49406d620 con 0x7fb494136b30 2024-09-16T06:46:36.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.819+0000 7fb490ff9640 1 -- 172.21.15.96:0/336269818 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb48c018070 con 0x7fb494136b30 2024-09-16T06:46:36.824 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 10 mgrc shutdown 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb480097840 msgr2=0x7fb480099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb480097840 0x7fb480099d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb48400bb10 tx=0x7fb4840a9070 comp rx=0 tx=0).stop 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494136b30 msgr2=0x7fb494144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494136b30 0x7fb494144300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4940a1f30 tx=0x7fb48c00cd20 comp rx=0 tx=0).stop 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 shutdown_connections 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb480097840 0x7fb480099d00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb494136b30 0x7fb494144300 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb494133610 0x7fb494143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 --2- 172.21.15.96:0/336269818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4940a6fe0 0x7fb49406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 >> 172.21.15.96:0/336269818 conn(0x7fb4940a4520 msgr2=0x7fb4941354e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:36.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 shutdown_connections 2024-09-16T06:46:36.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.823+0000 7fb49a9e9640 1 -- 172.21.15.96:0/336269818 wait complete. 2024-09-16T06:46:36.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T06:46:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.943+0000 7f5726b7c640 1 Processor -- start 2024-09-16T06:46:36.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.943+0000 7f5726b7c640 1 -- start start 2024-09-16T06:46:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5726b7c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a5100 0x7f57201473a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5726b7c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f57200a70a0 0x7f572014def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5726b7c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57200a54e0 con 0x7f57200a5990 2024-09-16T06:46:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5726b7c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200a43a0 con 0x7f57200a70a0 2024-09-16T06:46:36.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5726b7c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5720146cb0 con 0x7f57200a5100 2024-09-16T06:46:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a5100 0x7f57201473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a5100 0x7f57201473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40356/0 (socket says 172.21.15.96:40356) 2024-09-16T06:46:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 -- 172.21.15.96:0/139140925 learned_addr learned my addr 172.21.15.96:0/139140925 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 -- 172.21.15.96:0/139140925 >> v2:172.21.15.134:3300/0 conn(0x7f57200a70a0 msgr2=0x7f572014def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 --2- 172.21.15.96:0/139140925 >> v2:172.21.15.134:3300/0 conn(0x7f57200a70a0 0x7f572014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 -- 172.21.15.96:0/139140925 >> v1:172.21.15.134:6789/0 conn(0x7f57200a5990 legacy=0x7f57200a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:36.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 -- 172.21.15.96:0/139140925 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5720146f50 con 0x7f57200a5100 2024-09-16T06:46:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f5724918640 1 --2- 172.21.15.96:0/139140925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a5100 0x7f57201473a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5718009e50 tx=0x7f571801c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=891b7881309d3078 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f571f7fe640 1 -- 172.21.15.96:0/139140925 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180a5870 con 0x7f57200a5100 2024-09-16T06:46:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f571f7fe640 1 -- 172.21.15.96:0/139140925 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57200a7970 con 0x7f57200a5100 2024-09-16T06:46:36.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.947+0000 7f571f7fe640 1 -- 172.21.15.96:0/139140925 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180a5bf0 con 0x7f57200a5100 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- 172.21.15.96:0/139140925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a5100 msgr2=0x7f57201473a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 --2- 172.21.15.96:0/139140925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a5100 0x7f57201473a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5718009e50 tx=0x7f571801c9d0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- 172.21.15.96:0/139140925 shutdown_connections 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 --2- 172.21.15.96:0/139140925 >> v2:172.21.15.134:3300/0 conn(0x7f57200a70a0 0x7f572014def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 --2- 172.21.15.96:0/139140925 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a5100 0x7f57201473a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- 172.21.15.96:0/139140925 >> 172.21.15.96:0/139140925 conn(0x7f572006b8a0 msgr2=0x7f57200a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- 172.21.15.96:0/139140925 shutdown_connections 2024-09-16T06:46:36.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- 172.21.15.96:0/139140925 wait complete. 2024-09-16T06:46:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 Processor -- start 2024-09-16T06:46:36.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- start start 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57200a5990 0x7f572009b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a70a0 0x7f5720136060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f572014c010 0x7f572014c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572014ca00 con 0x7f572014c010 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572014d1b0 con 0x7f57200a5990 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572014b720 con 0x7f57200a70a0 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a70a0 0x7f5720136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a70a0 0x7f5720136060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40372/0 (socket says 172.21.15.96:40372) 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 -- 172.21.15.96:0/1523714028 learned_addr learned my addr 172.21.15.96:0/1523714028 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5725119640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f572014c010 0x7f572014c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 -- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57200a5990 msgr2=0x7f572009b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57200a5990 0x7f572009b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 -- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f572014c010 msgr2=0x7f572014c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:36.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f572014c010 0x7f572014c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 -- 172.21.15.96:0/1523714028 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009b30 con 0x7f57200a70a0 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571ffff640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a70a0 0x7f5720136060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f570800c490 tx=0x7f5708001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571d7fa640 1 -- 172.21.15.96:0/1523714028 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708003600 con 0x7f57200a70a0 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571d7fa640 1 -- 172.21.15.96:0/1523714028 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5708003780 con 0x7f57200a70a0 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f571d7fa640 1 -- 172.21.15.96:0/1523714028 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708003b70 con 0x7f57200a70a0 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572014b9c0 con 0x7f57200a70a0 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.951+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572009b680 con 0x7f57200a70a0 2024-09-16T06:46:36.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57201473a0 con 0x7f57200a70a0 2024-09-16T06:46:36.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f571d7fa640 1 -- 172.21.15.96:0/1523714028 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f5708003cd0 con 0x7f57200a70a0 2024-09-16T06:46:36.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f571d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:36.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f571d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:36.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f571d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f571d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:36.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f571d7fa640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f57000978c0 0x7f5700099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:36.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f571d7fa640 1 -- 172.21.15.96:0/1523714028 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f57080bee90 con 0x7f57200a70a0 2024-09-16T06:46:36.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f5724918640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f57000978c0 0x7f5700099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:36.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.955+0000 7f5724918640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f57000978c0 0x7f5700099d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57180ae000 tx=0x7f5718004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:36.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:36.959+0000 7f571d7fa640 1 -- 172.21.15.96:0/1523714028 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f570808c830 con 0x7f57200a70a0 2024-09-16T06:46:37.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f57200a2cc0 con 0x7f57200a70a0 2024-09-16T06:46:37.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f571d7fa640 1 -- 172.21.15.96:0/1523714028 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5708017070 con 0x7f57200a70a0 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 2, 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": "rbd" 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-09-16T06:46:37.118 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-09-16T06:46:37.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 10 mgrc shutdown 2024-09-16T06:46:37.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f57000978c0 msgr2=0x7f5700099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f57000978c0 0x7f5700099d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57180ae000 tx=0x7f5718004ac0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a70a0 msgr2=0x7f5720136060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a70a0 0x7f5720136060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f570800c490 tx=0x7f5708001e80 comp rx=0 tx=0).stop 2024-09-16T06:46:37.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 shutdown_connections 2024-09-16T06:46:37.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f57000978c0 0x7f5700099d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f572014c010 0x7f572014c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f57200a70a0 0x7f5720136060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 --2- 172.21.15.96:0/1523714028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57200a5990 0x7f572009b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 >> 172.21.15.96:0/1523714028 conn(0x7f572006b8a0 msgr2=0x7f57200b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:37.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 shutdown_connections 2024-09-16T06:46:37.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.115+0000 7f5726b7c640 1 -- 172.21.15.96:0/1523714028 wait complete. 2024-09-16T06:46:37.136 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T06:46:37.136 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T06:46:37.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843bba0640 1 Processor -- start 2024-09-16T06:46:37.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843bba0640 1 -- start start 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843bba0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f84340b7e00 0x7f8434137540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843bba0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8434144af0 con 0x7f8434145050 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843bba0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8434144d90 con 0x7f84340b7a20 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843bba0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84340a47c0 con 0x7f84340b7e00 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843913b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f84340b7e00 0x7f8434137540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843a13d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8434145050 0x7f843414bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36226/0 (socket says 172.21.15.96:36226) 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843a13d640 1 -- 172.21.15.96:0/1677499262 learned_addr learned my addr 172.21.15.96:0/1677499262 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843913b640 1 -- 172.21.15.96:0/1677499262 >> v1:172.21.15.134:6789/0 conn(0x7f84340b7a20 legacy=0x7f8434070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843913b640 1 -- 172.21.15.96:0/1677499262 >> v1:172.21.15.96:6789/0 conn(0x7f8434145050 legacy=0x7f843414bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.255+0000 7f843913b640 1 -- 172.21.15.96:0/1677499262 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434137a80 con 0x7f84340b7e00 2024-09-16T06:46:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843913b640 1 --2- 172.21.15.96:0/1677499262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7e00 0x7f8434137540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f84240097c0 tx=0x7f842401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f51a8cc770dd64 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843893a640 1 -- 172.21.15.96:0/1677499262 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240ab600 con 0x7f84340b7e00 2024-09-16T06:46:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843893a640 1 -- 172.21.15.96:0/1677499262 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84240a7050 con 0x7f84340b7e00 2024-09-16T06:46:37.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843893a640 1 -- 172.21.15.96:0/1677499262 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240ab980 con 0x7f84340b7e00 2024-09-16T06:46:37.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- 172.21.15.96:0/1677499262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7e00 msgr2=0x7f8434137540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 --2- 172.21.15.96:0/1677499262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7e00 0x7f8434137540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f84240097c0 tx=0x7f842401c240 comp rx=0 tx=0).stop 2024-09-16T06:46:37.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- 172.21.15.96:0/1677499262 shutdown_connections 2024-09-16T06:46:37.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 --2- 172.21.15.96:0/1677499262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7e00 0x7f8434137540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- 172.21.15.96:0/1677499262 >> 172.21.15.96:0/1677499262 conn(0x7f8434072d40 msgr2=0x7f8434073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:37.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- 172.21.15.96:0/1677499262 shutdown_connections 2024-09-16T06:46:37.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- 172.21.15.96:0/1677499262 wait complete. 2024-09-16T06:46:37.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 Processor -- start 2024-09-16T06:46:37.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- start start 2024-09-16T06:46:37.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7a20 0x7f84340a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8434145050 0x7f8434099560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84340b26d0 0x7f843414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843414b510 con 0x7f84340b7a20 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843414b7d0 con 0x7f8434145050 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8434098ca0 con 0x7f84340b26d0 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84340b26d0 0x7f843414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84340b26d0 0x7f843414bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40374/0 (socket says 172.21.15.96:40374) 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 -- 172.21.15.96:0/72546122 learned_addr learned my addr 172.21.15.96:0/72546122 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843993c640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7a20 0x7f84340a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843913b640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8434145050 0x7f8434099560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 -- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8434145050 msgr2=0x7f8434099560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8434145050 0x7f8434099560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 -- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7a20 msgr2=0x7f84340a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7a20 0x7f84340a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 -- 172.21.15.96:0/72546122 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009420 con 0x7f84340b26d0 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843993c640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7a20 0x7f84340a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843a13d640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84340b26d0 0x7f843414bc20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f842c00caf0 tx=0x7f842c002120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f842a7fc640 1 -- 172.21.15.96:0/72546122 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00a760 con 0x7f84340b26d0 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f842a7fc640 1 -- 172.21.15.96:0/72546122 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00a8c0 con 0x7f84340b26d0 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84340a0b20 con 0x7f84340b26d0 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f842a7fc640 1 -- 172.21.15.96:0/72546122 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00ac90 con 0x7f84340b26d0 2024-09-16T06:46:37.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.259+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8434099aa0 con 0x7f84340b26d0 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84340a62a0 con 0x7f84340b26d0 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f842a7fc640 1 -- 172.21.15.96:0/72546122 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f842c0070d0 con 0x7f84340b26d0 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f842a7fc640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f842a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f842a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f842a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f842a7fc640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8418097870 0x7f8418099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f842a7fc640 1 -- 172.21.15.96:0/72546122 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3538+0+0 (secure 0 0 0) 0x7f842c0bf670 con 0x7f84340b26d0 2024-09-16T06:46:37.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f843993c640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8418097870 0x7f8418099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.263+0000 7f843993c640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8418097870 0x7f8418099d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8430009cd0 tx=0x7f8430009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:37.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.267+0000 7f842a7fc640 1 -- 172.21.15.96:0/72546122 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f842c08d140 con 0x7f84340b26d0 2024-09-16T06:46:37.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.423+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8434137540 con 0x7f84340b26d0 2024-09-16T06:46:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.767+0000 7f842a7fc640 1 -- 172.21.15.96:0/72546122 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f842c018020 con 0x7f84340b26d0 2024-09-16T06:46:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-09-16T06:46:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 10 mgrc shutdown 2024-09-16T06:46:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8418097870 msgr2=0x7f8418099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8418097870 0x7f8418099d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8430009cd0 tx=0x7f8430009060 comp rx=0 tx=0).stop 2024-09-16T06:46:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84340b26d0 msgr2=0x7f843414bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84340b26d0 0x7f843414bc20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f842c00caf0 tx=0x7f842c002120 comp rx=0 tx=0).stop 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 shutdown_connections 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8418097870 0x7f8418099d30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f84340b26d0 0x7f843414bc20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8434145050 0x7f8434099560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 --2- 172.21.15.96:0/72546122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84340b7a20 0x7f84340a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 >> 172.21.15.96:0/72546122 conn(0x7f8434072d40 msgr2=0x7f84341436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 shutdown_connections 2024-09-16T06:46:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.771+0000 7f843bba0640 1 -- 172.21.15.96:0/72546122 wait complete. 2024-09-16T06:46:37.797 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T06:46:37.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f00769c7640 1 Processor -- start 2024-09-16T06:46:37.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f00769c7640 1 -- start start 2024-09-16T06:46:37.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f00769c7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f007006d700 0x7f007006a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f00769c7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f00701453d0 0x7f007014c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f00769c7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007006a320 con 0x7f0070069f40 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f00769c7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007006db00 con 0x7f00701453d0 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f00769c7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007006ad00 con 0x7f007006d700 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0067fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f007006d700 0x7f007006a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0067fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f007006d700 0x7f007006a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40390/0 (socket says 172.21.15.96:40390) 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0067fff640 1 -- 172.21.15.96:0/2913181658 learned_addr learned my addr 172.21.15.96:0/2913181658 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0074f64640 1 --2- 172.21.15.96:0/2913181658 >> v2:172.21.15.134:3300/0 conn(0x7f00701453d0 0x7f007014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0067fff640 1 -- 172.21.15.96:0/2913181658 >> v2:172.21.15.134:3300/0 conn(0x7f00701453d0 msgr2=0x7f007014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0067fff640 1 --2- 172.21.15.96:0/2913181658 >> v2:172.21.15.134:3300/0 conn(0x7f00701453d0 0x7f007014c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0067fff640 1 -- 172.21.15.96:0/2913181658 >> v1:172.21.15.134:6789/0 conn(0x7f0070069f40 legacy=0x7f0070144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:37.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.923+0000 7f0067fff640 1 -- 172.21.15.96:0/2913181658 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007006e840 con 0x7f007006d700 2024-09-16T06:46:37.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0067fff640 1 --2- 172.21.15.96:0/2913181658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f007006d700 0x7f007006a5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0058009870 tx=0x7f005801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acab4eca92d92457 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:37.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006f7fe640 1 -- 172.21.15.96:0/2913181658 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580ac620 con 0x7f007006d700 2024-09-16T06:46:37.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006f7fe640 1 -- 172.21.15.96:0/2913181658 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00580ac780 con 0x7f007006d700 2024-09-16T06:46:37.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006f7fe640 1 -- 172.21.15.96:0/2913181658 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580acb10 con 0x7f007006d700 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- 172.21.15.96:0/2913181658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f007006d700 msgr2=0x7f007006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 --2- 172.21.15.96:0/2913181658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f007006d700 0x7f007006a5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0058009870 tx=0x7f005801c3e0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- 172.21.15.96:0/2913181658 shutdown_connections 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 --2- 172.21.15.96:0/2913181658 >> v2:172.21.15.134:3300/0 conn(0x7f00701453d0 0x7f007014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 --2- 172.21.15.96:0/2913181658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f007006d700 0x7f007006a5d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- 172.21.15.96:0/2913181658 >> 172.21.15.96:0/2913181658 conn(0x7f00700a4520 msgr2=0x7f00700a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- 172.21.15.96:0/2913181658 shutdown_connections 2024-09-16T06:46:37.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- 172.21.15.96:0/2913181658 wait complete. 2024-09-16T06:46:37.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 Processor -- start 2024-09-16T06:46:37.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- start start 2024-09-16T06:46:37.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0070069f40 0x7f0070149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007006d700 0x7f0070149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00701453d0 0x7f007014a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007013ae00 con 0x7f0070069f40 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070143ab0 con 0x7f007006d700 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007014ab40 con 0x7f00701453d0 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00701453d0 0x7f007014a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00701453d0 0x7f007014a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40392/0 (socket says 172.21.15.96:40392) 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0070069f40 0x7f0070149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 -- 172.21.15.96:0/4234131802 learned_addr learned my addr 172.21.15.96:0/4234131802 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0067fff640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007006d700 0x7f0070149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 -- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007006d700 msgr2=0x7f0070149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007006d700 0x7f0070149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 -- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0070069f40 msgr2=0x7f0070149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:37.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0070069f40 0x7f0070149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 -- 172.21.15.96:0/4234131802 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580094d0 con 0x7f00701453d0 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006ffff640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0070069f40 0x7f0070149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f0074f64640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00701453d0 0x7f007014a460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0068007e90 tx=0x7f006800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006d7fa640 1 -- 172.21.15.96:0/4234131802 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068014420 con 0x7f00701453d0 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006d7fa640 1 -- 172.21.15.96:0/4234131802 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068014580 con 0x7f00701453d0 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007014ae00 con 0x7f00701453d0 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f006d7fa640 1 -- 172.21.15.96:0/4234131802 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068014930 con 0x7f00701453d0 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.927+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007013b550 con 0x7f00701453d0 2024-09-16T06:46:37.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00701437d0 con 0x7f00701453d0 2024-09-16T06:46:37.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006d7fa640 1 -- 172.21.15.96:0/4234131802 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f0068014a90 con 0x7f00701453d0 2024-09-16T06:46:37.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006d7fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:37.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:37.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:37.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:37.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006d7fa640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0050097840 0x7f0050099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:37.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006d7fa640 1 -- 172.21.15.96:0/4234131802 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3880+0+0 (secure 0 0 0) 0x7f00680c10a0 con 0x7f00701453d0 2024-09-16T06:46:37.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.931+0000 7f006ffff640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0050097840 0x7f0050099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:37.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.935+0000 7f006ffff640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0050097840 0x7f0050099d00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0060007fd0 tx=0x7f0060007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:37.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:37.935+0000 7f006d7fa640 1 -- 172.21.15.96:0/4234131802 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f006808ea20 con 0x7f00701453d0 2024-09-16T06:46:38.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.095+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f00701437d0 con 0x7f00701453d0 2024-09-16T06:46:38.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.779+0000 7f006d7fa640 1 -- 172.21.15.96:0/4234131802 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f00701437d0 con 0x7f00701453d0 2024-09-16T06:46:38.792 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 10 mgrc shutdown 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0050097840 msgr2=0x7f0050099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0050097840 0x7f0050099d00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0060007fd0 tx=0x7f0060007e40 comp rx=0 tx=0).stop 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00701453d0 msgr2=0x7f007014a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00701453d0 0x7f007014a460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0068007e90 tx=0x7f006800e4b0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 shutdown_connections 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0050097840 0x7f0050099d00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00701453d0 0x7f007014a460 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f007006d700 0x7f0070149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 --2- 172.21.15.96:0/4234131802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0070069f40 0x7f0070149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 >> 172.21.15.96:0/4234131802 conn(0x7f00700a4520 msgr2=0x7f0070144530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 shutdown_connections 2024-09-16T06:46:38.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.791+0000 7f00769c7640 1 -- 172.21.15.96:0/4234131802 wait complete. 2024-09-16T06:46:38.818 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T06:46:38.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 Processor -- start 2024-09-16T06:46:38.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 -- start start 2024-09-16T06:46:38.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:38.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8fa006a5d0 0x7f8fa0144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8fa0145200 0x7f8fa0145690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa006a320 con 0x7f8fa0145200 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa006ad00 con 0x7f8fa006a5d0 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8fa5bc3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa006e840 con 0x7f8fa0069f40 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8fa0145200 0x7f8fa0145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa006d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40402/0 (socket says 172.21.15.96:40402) 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 -- 172.21.15.96:0/572167235 learned_addr learned my addr 172.21.15.96:0/572167235 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 -- 172.21.15.96:0/572167235 >> v2:172.21.15.134:3300/0 conn(0x7f8fa006a5d0 msgr2=0x7f8fa0144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:38.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 --2- 172.21.15.96:0/572167235 >> v2:172.21.15.134:3300/0 conn(0x7f8fa006a5d0 0x7f8fa0144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 -- 172.21.15.96:0/572167235 >> v2:172.21.15.96:3300/0 conn(0x7f8fa0145200 msgr2=0x7f8fa0145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:38.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 --2- 172.21.15.96:0/572167235 >> v2:172.21.15.96:3300/0 conn(0x7f8fa0145200 0x7f8fa0145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9f7fe640 1 -- 172.21.15.96:0/572167235 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa006a9d0 con 0x7f8fa0069f40 2024-09-16T06:46:38.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.939+0000 7f8f9ffff640 1 --2- 172.21.15.96:0/572167235 >> v2:172.21.15.96:3300/0 conn(0x7f8fa0145200 0x7f8fa0145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:38.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8f9f7fe640 1 --2- 172.21.15.96:0/572167235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa006d700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00a39f0 tx=0x7f8f9001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3131b9122a146af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:38.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8f9e7fc640 1 -- 172.21.15.96:0/572167235 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f900ab650 con 0x7f8fa0069f40 2024-09-16T06:46:38.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8f9e7fc640 1 -- 172.21.15.96:0/572167235 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f900ab7b0 con 0x7f8fa0069f40 2024-09-16T06:46:38.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8f9e7fc640 1 -- 172.21.15.96:0/572167235 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f900abb40 con 0x7f8fa0069f40 2024-09-16T06:46:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/572167235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 msgr2=0x7f8fa006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/572167235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa006d700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00a39f0 tx=0x7f8f9001c470 comp rx=0 tx=0).stop 2024-09-16T06:46:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/572167235 shutdown_connections 2024-09-16T06:46:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/572167235 >> v2:172.21.15.96:3300/0 conn(0x7f8fa0145200 0x7f8fa0145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/572167235 >> v2:172.21.15.134:3300/0 conn(0x7f8fa006a5d0 0x7f8fa0144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/572167235 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa006d700 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/572167235 >> 172.21.15.96:0/572167235 conn(0x7f8fa00a4520 msgr2=0x7f8fa00a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:38.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/572167235 shutdown_connections 2024-09-16T06:46:38.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.943+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/572167235 wait complete. 2024-09-16T06:46:38.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 Processor -- start 2024-09-16T06:46:38.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 -- start start 2024-09-16T06:46:38.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa00b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:38.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fa006a5d0 0x7f8fa01351b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:38.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fa0145200 0x7f8fa01356f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:38.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa0135c30 con 0x7f8fa006a5d0 2024-09-16T06:46:38.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa0139d90 con 0x7f8fa0145200 2024-09-16T06:46:38.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa013c3e0 con 0x7f8fa0069f40 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fa006a5d0 0x7f8fa01351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa00b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa00b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40416/0 (socket says 172.21.15.96:40416) 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9f7fe640 1 -- 172.21.15.96:0/1374298806 learned_addr learned my addr 172.21.15.96:0/1374298806 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9ffff640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fa0145200 0x7f8fa01356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9effd640 1 -- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 msgr2=0x7f8fa00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9effd640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa00b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9effd640 1 -- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fa0145200 msgr2=0x7f8fa01356f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9effd640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fa0145200 0x7f8fa01356f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9effd640 1 -- 172.21.15.96:0/1374298806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98009a70 con 0x7f8fa006a5d0 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9f7fe640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa00b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:38.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f9effd640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fa006a5d0 0x7f8fa01351b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b3f0 tx=0x7f8f9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f87fff640 1 -- 172.21.15.96:0/1374298806 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94011830 con 0x7f8fa006a5d0 2024-09-16T06:46:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f87fff640 1 -- 172.21.15.96:0/1374298806 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f940119b0 con 0x7f8fa006a5d0 2024-09-16T06:46:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f87fff640 1 -- 172.21.15.96:0/1374298806 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94011d60 con 0x7f8fa006a5d0 2024-09-16T06:46:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f900094d0 con 0x7f8fa006a5d0 2024-09-16T06:46:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa00af960 con 0x7f8fa006a5d0 2024-09-16T06:46:38.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa013e500 con 0x7f8fa006a5d0 2024-09-16T06:46:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f87fff640 1 -- 172.21.15.96:0/1374298806 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f8f9401a400 con 0x7f8fa006a5d0 2024-09-16T06:46:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.947+0000 7f8f87fff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.951+0000 7f8f87fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.951+0000 7f8f87fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.951+0000 7f8f87fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.951+0000 7f8f87fff640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8f8c097870 0x7f8f8c099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:38.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.951+0000 7f8f87fff640 1 -- 172.21.15.96:0/1374298806 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4262+0+0 (secure 0 0 0) 0x7f8f940c0320 con 0x7f8fa006a5d0 2024-09-16T06:46:38.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.951+0000 7f8f9f7fe640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8f8c097870 0x7f8f8c099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:38.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.951+0000 7f8f9f7fe640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8f8c097870 0x7f8f8c099d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f9001c4b0 tx=0x7f8f900b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:38.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:38.955+0000 7f8f87fff640 1 -- 172.21.15.96:0/1374298806 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f9408da90 con 0x7f8fa006a5d0 2024-09-16T06:46:39.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.147+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8fa0072340 con 0x7f8fa006a5d0 2024-09-16T06:46:39.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.155+0000 7f8f87fff640 1 -- 172.21.15.96:0/1374298806 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8f940150c0 con 0x7f8fa006a5d0 2024-09-16T06:46:39.160 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 3 and data pool 4 2024-09-16T06:46:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 10 mgrc shutdown 2024-09-16T06:46:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8f8c097870 msgr2=0x7f8f8c099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8f8c097870 0x7f8f8c099d30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8f9001c4b0 tx=0x7f8f900b6040 comp rx=0 tx=0).stop 2024-09-16T06:46:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fa006a5d0 msgr2=0x7f8fa01351b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fa006a5d0 0x7f8fa01351b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400b3f0 tx=0x7f8f9400b8b0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 shutdown_connections 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8f8c097870 0x7f8f8c099d30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8fa006a5d0 0x7f8fa01351b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8fa0145200 0x7f8fa01356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 --2- 172.21.15.96:0/1374298806 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8fa0069f40 0x7f8fa00b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 >> 172.21.15.96:0/1374298806 conn(0x7f8fa00a4520 msgr2=0x7f8fa00a2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 shutdown_connections 2024-09-16T06:46:39.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.159+0000 7f8fa5bc3640 1 -- 172.21.15.96:0/1374298806 wait complete. 2024-09-16T06:46:39.187 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:39.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.335+0000 7f87120c3640 1 Processor -- start 2024-09-16T06:46:39.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.335+0000 7f87120c3640 1 -- start start 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.335+0000 7f87120c3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f870c0a5100 0x7f870c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.335+0000 7f87120c3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f870c0a40e0 0x7f870c144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.335+0000 7f87120c3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c1449e0 con 0x7f870c137b20 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.335+0000 7f87120c3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c0a54e0 con 0x7f870c0a40e0 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.335+0000 7f87120c3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c06d7b0 con 0x7f870c0a5100 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f870c0a40e0 0x7f870c144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f870c0a40e0 0x7f870c144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35916/0 (socket says 172.21.15.96:35916) 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 -- 172.21.15.96:0/1218414984 learned_addr learned my addr 172.21.15.96:0/1218414984 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870b7fe640 1 --2- 172.21.15.96:0/1218414984 >> v2:172.21.15.134:3300/0 conn(0x7f870c0a5100 0x7f870c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 -- 172.21.15.96:0/1218414984 >> v2:172.21.15.134:3300/0 conn(0x7f870c0a5100 msgr2=0x7f870c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 --2- 172.21.15.96:0/1218414984 >> v2:172.21.15.134:3300/0 conn(0x7f870c0a5100 0x7f870c06e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 -- 172.21.15.96:0/1218414984 >> v1:172.21.15.134:6789/0 conn(0x7f870c137b20 legacy=0x7f870c133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 -- 172.21.15.96:0/1218414984 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c144c10 con 0x7f870c0a40e0 2024-09-16T06:46:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870affd640 1 --2- 172.21.15.96:0/1218414984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c144ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f870c0a7ba0 tx=0x7f86fc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79e453d71323bff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870a7fc640 1 -- 172.21.15.96:0/1218414984 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0ac600 con 0x7f870c0a40e0 2024-09-16T06:46:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870a7fc640 1 -- 172.21.15.96:0/1218414984 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc0a8050 con 0x7f870c0a40e0 2024-09-16T06:46:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f870a7fc640 1 -- 172.21.15.96:0/1218414984 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0ac980 con 0x7f870c0a40e0 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 -- 172.21.15.96:0/1218414984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 msgr2=0x7f870c144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 --2- 172.21.15.96:0/1218414984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c144ed0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f870c0a7ba0 tx=0x7f86fc01c4f0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 -- 172.21.15.96:0/1218414984 shutdown_connections 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 --2- 172.21.15.96:0/1218414984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c144ed0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 --2- 172.21.15.96:0/1218414984 >> v2:172.21.15.134:3300/0 conn(0x7f870c0a5100 0x7f870c06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 -- 172.21.15.96:0/1218414984 >> 172.21.15.96:0/1218414984 conn(0x7f870c06b8a0 msgr2=0x7f870c0a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 -- 172.21.15.96:0/1218414984 shutdown_connections 2024-09-16T06:46:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.339+0000 7f87120c3640 1 -- 172.21.15.96:0/1218414984 wait complete. 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 Processor -- start 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 -- start start 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c0b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f870c0a5100 0x7f870c1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f870c137b20 0x7f870c141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0707a0 con 0x7f870c0a40e0 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0b3cd0 con 0x7f870c137b20 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0b3f90 con 0x7f870c0a5100 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f870c0a5100 0x7f870c1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c0b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c0b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35930/0 (socket says 172.21.15.96:35930) 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f870c0a5100 0x7f870c1416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40420/0 (socket says 172.21.15.96:40420) 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 -- 172.21.15.96:0/2761149206 learned_addr learned my addr 172.21.15.96:0/2761149206 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870bfff640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f870c137b20 0x7f870c141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 -- 172.21.15.96:0/2761149206 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f870c0a5100 msgr2=0x7f870c1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f870c0a5100 0x7f870c1416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 -- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f870c137b20 msgr2=0x7f870c141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f870c137b20 0x7f870c141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 -- 172.21.15.96:0/2761149206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0094d0 con 0x7f870c0a40e0 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870bfff640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f870c137b20 0x7f870c141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f870b7fe640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c0b4ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f870000c7f0 tx=0x7f870000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f86f3fff640 1 -- 172.21.15.96:0/2761149206 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700004220 con 0x7f870c0a40e0 2024-09-16T06:46:39.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f86f3fff640 1 -- 172.21.15.96:0/2761149206 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87000043a0 con 0x7f870c0a40e0 2024-09-16T06:46:39.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f86f3fff640 1 -- 172.21.15.96:0/2761149206 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700004510 con 0x7f870c0a40e0 2024-09-16T06:46:39.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c0af170 con 0x7f870c0a40e0 2024-09-16T06:46:39.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c06ea90 con 0x7f870c0a40e0 2024-09-16T06:46:39.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.343+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c144ed0 con 0x7f870c0a40e0 2024-09-16T06:46:39.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 1 -- 172.21.15.96:0/2761149206 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f8700003a70 con 0x7f870c0a40e0 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f86f8097840 0x7f86f8099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 1 -- 172.21.15.96:0/2761149206 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f87000c00e0 con 0x7f870c0a40e0 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f870affd640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f86f8097840 0x7f86f8099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f870affd640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f86f8097840 0x7f86f8099d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0ae000 tx=0x7f86fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.347+0000 7f86f3fff640 1 -- 172.21.15.96:0/2761149206 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f870008d7f0 con 0x7f870c0a40e0 2024-09-16T06:46:39.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.511+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f870c0a2d00 con 0x7f870c0a40e0 2024-09-16T06:46:39.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.511+0000 7f86f3fff640 1 -- 172.21.15.96:0/2761149206 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7f870008f720 con 0x7f870c0a40e0 2024-09-16T06:46:39.516 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:39.516 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:39.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 10 mgrc shutdown 2024-09-16T06:46:39.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f86f8097840 msgr2=0x7f86f8099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f86f8097840 0x7f86f8099d00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0ae000 tx=0x7f86fc008040 comp rx=0 tx=0).stop 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 msgr2=0x7f870c0b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c0b4ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f870000c7f0 tx=0x7f870000ccb0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 shutdown_connections 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f86f8097840 0x7f86f8099d00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f870c137b20 0x7f870c141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f870c0a5100 0x7f870c1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 --2- 172.21.15.96:0/2761149206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f870c0a40e0 0x7f870c0b4ff0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 >> 172.21.15.96:0/2761149206 conn(0x7f870c06b8a0 msgr2=0x7f870c070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 shutdown_connections 2024-09-16T06:46:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.515+0000 7f87120c3640 1 -- 172.21.15.96:0/2761149206 wait complete. 2024-09-16T06:46:39.535 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:39.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4e0c77640 1 Processor -- start 2024-09-16T06:46:39.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4e0c77640 1 -- start start 2024-09-16T06:46:39.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4e0c77640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a3db0 0x7ff4dc06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4e0c77640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff4dc0a4190 0x7ff4dc144000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4e0c77640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4dc143ab0 con 0x7ff4dc06db60 2024-09-16T06:46:39.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4e0c77640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4dc06b020 con 0x7ff4dc0a4190 2024-09-16T06:46:39.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4e0c77640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc0a5410 con 0x7ff4dc0a3db0 2024-09-16T06:46:39.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4dad9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff4dc06db60 0x7ff4dc069ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36234/0 (socket says 172.21.15.96:36234) 2024-09-16T06:46:39.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4dad9d640 1 -- 172.21.15.96:0/3121928979 learned_addr learned my addr 172.21.15.96:0/3121928979 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4da59c640 1 --2- 172.21.15.96:0/3121928979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a3db0 0x7ff4dc06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4d9d9b640 1 -- 172.21.15.96:0/3121928979 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191773091 0 0) 0x7ff4dc143ab0 con 0x7ff4dc06db60 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4d1d9b640 1 --2- 172.21.15.96:0/3121928979 >> v2:172.21.15.134:3300/0 conn(0x7ff4dc0a4190 0x7ff4dc144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4d9d9b640 1 -- 172.21.15.96:0/3121928979 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c8003530 con 0x7ff4dc06db60 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4da59c640 1 -- 172.21.15.96:0/3121928979 >> v2:172.21.15.134:3300/0 conn(0x7ff4dc0a4190 msgr2=0x7ff4dc144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4da59c640 1 --2- 172.21.15.96:0/3121928979 >> v2:172.21.15.134:3300/0 conn(0x7ff4dc0a4190 0x7ff4dc144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4da59c640 1 -- 172.21.15.96:0/3121928979 >> v1:172.21.15.96:6789/0 conn(0x7ff4dc06db60 legacy=0x7ff4dc069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.647+0000 7ff4da59c640 1 -- 172.21.15.96:0/3121928979 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc1401b0 con 0x7ff4dc0a3db0 2024-09-16T06:46:39.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4da59c640 1 --2- 172.21.15.96:0/3121928979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a3db0 0x7ff4dc06d620 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0097c0 tx=0x7ff4cc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6df05b40c62e1b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4d9d9b640 1 -- 172.21.15.96:0/3121928979 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0ab620 con 0x7ff4dc0a3db0 2024-09-16T06:46:39.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4d9d9b640 1 -- 172.21.15.96:0/3121928979 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc0ab780 con 0x7ff4dc0a3db0 2024-09-16T06:46:39.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4d9d9b640 1 -- 172.21.15.96:0/3121928979 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0abb10 con 0x7ff4dc0a3db0 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3121928979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a3db0 msgr2=0x7ff4dc06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3121928979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a3db0 0x7ff4dc06d620 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0097c0 tx=0x7ff4cc01c480 comp rx=0 tx=0).stop 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3121928979 shutdown_connections 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3121928979 >> v2:172.21.15.134:3300/0 conn(0x7ff4dc0a4190 0x7ff4dc144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3121928979 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a3db0 0x7ff4dc06d620 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3121928979 >> 172.21.15.96:0/3121928979 conn(0x7ff4dc06b8a0 msgr2=0x7ff4dc0a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3121928979 shutdown_connections 2024-09-16T06:46:39.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.651+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3121928979 wait complete. 2024-09-16T06:46:39.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 Processor -- start 2024-09-16T06:46:39.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 -- start start 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc06db60 0x7ff4dc0994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4dc0a3db0 0x7ff4dc09a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a4190 0x7ff4dc1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc099ec0 con 0x7ff4dc0a3db0 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc09b070 con 0x7ff4dc06db60 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4dc14a860 con 0x7ff4dc0a4190 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4d1d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4dc0a3db0 0x7ff4dc09a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4dad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a4190 0x7ff4dc1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4d1d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4dc0a3db0 0x7ff4dc09a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35934/0 (socket says 172.21.15.96:35934) 2024-09-16T06:46:39.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4d1d9b640 1 -- 172.21.15.96:0/3154291867 learned_addr learned my addr 172.21.15.96:0/3154291867 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4da59c640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc06db60 0x7ff4dc0994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4dad9d640 1 -- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc06db60 msgr2=0x7ff4dc0994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4dad9d640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc06db60 0x7ff4dc0994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4dad9d640 1 -- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4dc0a3db0 msgr2=0x7ff4dc09a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4dad9d640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4dc0a3db0 0x7ff4dc09a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4dad9d640 1 -- 172.21.15.96:0/3154291867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009420 con 0x7ff4dc0a4190 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4da59c640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc06db60 0x7ff4dc0994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4d1d9b640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4dc0a3db0 0x7ff4dc09a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4dad9d640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a4190 0x7ff4dc1492e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400ca50 tx=0x7ff4d400cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4d37fe640 1 -- 172.21.15.96:0/3154291867 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d400abb0 con 0x7ff4dc0a4190 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4d37fe640 1 -- 172.21.15.96:0/3154291867 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d400ad10 con 0x7ff4dc0a4190 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc148d70 con 0x7ff4dc0a4190 2024-09-16T06:46:39.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4d37fe640 1 -- 172.21.15.96:0/3154291867 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4012600 con 0x7ff4dc0a4190 2024-09-16T06:46:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4dc0a2970 con 0x7ff4dc0a4190 2024-09-16T06:46:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.655+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4dc14a580 con 0x7ff4dc0a4190 2024-09-16T06:46:39.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4d37fe640 1 -- 172.21.15.96:0/3154291867 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7ff4d4007070 con 0x7ff4dc0a4190 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4d37fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4d37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4d37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4d37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4d37fe640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff4bc097870 0x7ff4bc099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4d37fe640 1 -- 172.21.15.96:0/3154291867 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7ff4d40bfd80 con 0x7ff4dc0a4190 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4da59c640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff4bc097870 0x7ff4bc099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.659+0000 7ff4da59c640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff4bc097870 0x7ff4bc099d30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0af000 tx=0x7ff4cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.663+0000 7ff4d37fe640 1 -- 172.21.15.96:0/3154291867 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4d408d540 con 0x7ff4dc0a4190 2024-09-16T06:46:39.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.823+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4dc14a580 con 0x7ff4dc0a4190 2024-09-16T06:46:39.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.823+0000 7ff4d37fe640 1 -- 172.21.15.96:0/3154291867 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7ff4dc14a580 con 0x7ff4dc0a4190 2024-09-16T06:46:39.827 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:39.827 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 10 mgrc shutdown 2024-09-16T06:46:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff4bc097870 msgr2=0x7ff4bc099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff4bc097870 0x7ff4bc099d30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc0af000 tx=0x7ff4cc008040 comp rx=0 tx=0).stop 2024-09-16T06:46:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a4190 msgr2=0x7ff4dc1492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a4190 0x7ff4dc1492e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400ca50 tx=0x7ff4d400cf10 comp rx=0 tx=0).stop 2024-09-16T06:46:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 shutdown_connections 2024-09-16T06:46:39.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff4bc097870 0x7ff4bc099d30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4dc0a3db0 0x7ff4dc09a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff4dc0a4190 0x7ff4dc1492e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 --2- 172.21.15.96:0/3154291867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4dc06db60 0x7ff4dc0994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 >> 172.21.15.96:0/3154291867 conn(0x7ff4dc06b8a0 msgr2=0x7ff4dc142440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 shutdown_connections 2024-09-16T06:46:39.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.827+0000 7ff4e0c77640 1 -- 172.21.15.96:0/3154291867 wait complete. 2024-09-16T06:46:39.847 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T06:46:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.967+0000 7fbb326db640 1 Processor -- start 2024-09-16T06:46:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.967+0000 7fbb326db640 1 -- start start 2024-09-16T06:46:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbb2c0a5c60 0x7fbb2c147440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb2c0a7580 0x7fbb2c14e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c146e60 con 0x7fbb2c069ce0 2024-09-16T06:46:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c147120 con 0x7fbb2c0a7580 2024-09-16T06:46:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0a68c0 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb30c78640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb2c0a7580 0x7fbb2c14e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb2b7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbb2c069ce0 0x7fbb2c0a6e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36248/0 (socket says 172.21.15.96:36248) 2024-09-16T06:46:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb2b7fe640 1 -- 172.21.15.96:0/4004684578 learned_addr learned my addr 172.21.15.96:0/4004684578 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb2bfff640 1 --2- 172.21.15.96:0/4004684578 >> v2:172.21.15.134:3300/0 conn(0x7fbb2c0a5c60 0x7fbb2c147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb30c78640 1 -- 172.21.15.96:0/4004684578 >> v2:172.21.15.134:3300/0 conn(0x7fbb2c0a5c60 msgr2=0x7fbb2c147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb30c78640 1 --2- 172.21.15.96:0/4004684578 >> v2:172.21.15.134:3300/0 conn(0x7fbb2c0a5c60 0x7fbb2c147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb30c78640 1 -- 172.21.15.96:0/4004684578 >> v1:172.21.15.96:6789/0 conn(0x7fbb2c069ce0 legacy=0x7fbb2c0a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb30c78640 1 -- 172.21.15.96:0/4004684578 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0a6040 con 0x7fbb2c0a7580 2024-09-16T06:46:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb2bfff640 1 --2- 172.21.15.96:0/4004684578 >> v2:172.21.15.134:3300/0 conn(0x7fbb2c0a5c60 0x7fbb2c147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:39.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb30c78640 1 --2- 172.21.15.96:0/4004684578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c14e050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0a8380 tx=0x7fbb1c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e72758cdf3f8fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb2affd640 1 -- 172.21.15.96:0/4004684578 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0ad660 con 0x7fbb2c0a7580 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb2affd640 1 -- 172.21.15.96:0/4004684578 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0ad7c0 con 0x7fbb2c0a7580 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb2affd640 1 -- 172.21.15.96:0/4004684578 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0adb50 con 0x7fbb2c0a7580 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- 172.21.15.96:0/4004684578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 msgr2=0x7fbb2c14e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 --2- 172.21.15.96:0/4004684578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c14e050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0a8380 tx=0x7fbb1c01c340 comp rx=0 tx=0).stop 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- 172.21.15.96:0/4004684578 shutdown_connections 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 --2- 172.21.15.96:0/4004684578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c14e050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 --2- 172.21.15.96:0/4004684578 >> v2:172.21.15.134:3300/0 conn(0x7fbb2c0a5c60 0x7fbb2c147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- 172.21.15.96:0/4004684578 >> 172.21.15.96:0/4004684578 conn(0x7fbb2c0a4520 msgr2=0x7fbb2c0a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- 172.21.15.96:0/4004684578 shutdown_connections 2024-09-16T06:46:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.971+0000 7fbb326db640 1 -- 172.21.15.96:0/4004684578 wait complete. 2024-09-16T06:46:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 Processor -- start 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 -- start start 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb2c069ce0 0x7fbb2c1360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2c0a5c60 0x7fbb2c0aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c0aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0b4390 con 0x7fbb2c0a7580 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ac0e0 con 0x7fbb2c069ce0 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ab6c0 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2c0a5c60 0x7fbb2c0aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2c0a5c60 0x7fbb2c0aa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40446/0 (socket says 172.21.15.96:40446) 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 -- 172.21.15.96:0/3398080867 learned_addr learned my addr 172.21.15.96:0/3398080867 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:39.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb30c78640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c0aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2bfff640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb2c069ce0 0x7fbb2c1360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 -- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb2c069ce0 msgr2=0x7fbb2c1360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb2c069ce0 0x7fbb2c1360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 -- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 msgr2=0x7fbb2c0aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c0aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 -- 172.21.15.96:0/3398080867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c009420 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2bfff640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb2c069ce0 0x7fbb2c1360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb30c78640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c0aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb2b7fe640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2c0a5c60 0x7fbb2c0aa610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000cba0 tx=0x7fbb2000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb28ff9640 1 -- 172.21.15.96:0/3398080867 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000ad40 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb28ff9640 1 -- 172.21.15.96:0/3398080867 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20012400 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb28ff9640 1 -- 172.21.15.96:0/3398080867 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000aea0 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c0ac3a0 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c145a00 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.975+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c0b40f0 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb28ff9640 1 -- 172.21.15.96:0/3398080867 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fbb20007070 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb28ff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb28ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb28ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb28ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb28ff9640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb18097840 0x7fbb18099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb28ff9640 1 -- 172.21.15.96:0/3398080867 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fbb200bfea0 con 0x7fbb2c0a5c60 2024-09-16T06:46:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb2bfff640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb18097840 0x7fbb18099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.979+0000 7fbb2bfff640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb18097840 0x7fbb18099d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb24008930 tx=0x7fbb24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:39.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:39.983+0000 7fbb28ff9640 1 -- 172.21.15.96:0/3398080867 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb2008d640 con 0x7fbb2c0a5c60 2024-09-16T06:46:40.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.163+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbb2c0b40f0 con 0x7fbb2c0a5c60 2024-09-16T06:46:40.754 INFO:tasks.ceph.mds.b.smithi134.stderr:2024-09-16T06:46:40.756+0000 7f22806e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T06:46:40.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.791+0000 7fbb28ff9640 1 -- 172.21.15.96:0/3398080867 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbb2c0b40f0 con 0x7fbb2c0a5c60 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.791+0000 7fbb326db640 10 mgrc shutdown 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb18097840 msgr2=0x7fbb18099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb18097840 0x7fbb18099d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb24008930 tx=0x7fbb24008040 comp rx=0 tx=0).stop 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2c0a5c60 msgr2=0x7fbb2c0aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2c0a5c60 0x7fbb2c0aa610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000cba0 tx=0x7fbb2000a430 comp rx=0 tx=0).stop 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 shutdown_connections 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb18097840 0x7fbb18099d00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbb2c0a7580 0x7fbb2c0aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2c0a5c60 0x7fbb2c0aa610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 --2- 172.21.15.96:0/3398080867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb2c069ce0 0x7fbb2c1360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 >> 172.21.15.96:0/3398080867 conn(0x7fbb2c0a4520 msgr2=0x7fbb2c1334f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 shutdown_connections 2024-09-16T06:46:40.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.795+0000 7fbb326db640 1 -- 172.21.15.96:0/3398080867 wait complete. 2024-09-16T06:46:40.820 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T06:46:40.820 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T06:46:40.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.943+0000 7fddf55f2640 1 Processor -- start 2024-09-16T06:46:40.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.943+0000 7fddf55f2640 1 -- start start 2024-09-16T06:46:40.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddf55f2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf0139ce0 0x7fddf00ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddf55f2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf00ba1c0 con 0x7fddf00b9de0 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddf55f2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf00aa0c0 con 0x7fddf00ab5d0 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddf55f2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf00a8690 con 0x7fddf0139ce0 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddeeffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fddf00b9de0 0x7fddf0147300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36258/0 (socket says 172.21.15.96:36258) 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddeeffd640 1 -- 172.21.15.96:0/1779971014 learned_addr learned my addr 172.21.15.96:0/1779971014 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddee7fc640 1 --2- 172.21.15.96:0/1779971014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf0139ce0 0x7fddf00ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddedffb640 1 -- 172.21.15.96:0/1779971014 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769091095 0 0) 0x7fddf00ba1c0 con 0x7fddf00b9de0 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddedffb640 1 -- 172.21.15.96:0/1779971014 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdddc003530 con 0x7fddf00b9de0 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddee7fc640 1 -- 172.21.15.96:0/1779971014 >> v1:172.21.15.134:6789/0 conn(0x7fddf00ab5d0 legacy=0x7fddf014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddee7fc640 1 -- 172.21.15.96:0/1779971014 >> v1:172.21.15.96:6789/0 conn(0x7fddf00b9de0 legacy=0x7fddf0147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:40.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddee7fc640 1 -- 172.21.15.96:0/1779971014 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0146d90 con 0x7fddf0139ce0 2024-09-16T06:46:40.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddee7fc640 1 --2- 172.21.15.96:0/1779971014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf0139ce0 0x7fddf00ab090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddd80097f0 tx=0x7fddd801cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cee1d6e95e97d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:40.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddedffb640 1 -- 172.21.15.96:0/1779971014 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80ab600 con 0x7fddf0139ce0 2024-09-16T06:46:40.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddedffb640 1 -- 172.21.15.96:0/1779971014 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd80a7050 con 0x7fddf0139ce0 2024-09-16T06:46:40.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.947+0000 7fddedffb640 1 -- 172.21.15.96:0/1779971014 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80ab980 con 0x7fddf0139ce0 2024-09-16T06:46:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/1779971014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf0139ce0 msgr2=0x7fddf00ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 --2- 172.21.15.96:0/1779971014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf0139ce0 0x7fddf00ab090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddd80097f0 tx=0x7fddd801cdc0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/1779971014 shutdown_connections 2024-09-16T06:46:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 --2- 172.21.15.96:0/1779971014 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf0139ce0 0x7fddf00ab090 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/1779971014 >> 172.21.15.96:0/1779971014 conn(0x7fddf0072b70 msgr2=0x7fddf0072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/1779971014 shutdown_connections 2024-09-16T06:46:40.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/1779971014 wait complete. 2024-09-16T06:46:40.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 Processor -- start 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- start start 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf00ab5d0 0x7fddf01db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf00b9de0 0x7fddf014a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0139ce0 0x7fddf014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01dc4e0 con 0x7fddf00b9de0 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01db830 con 0x7fddf0139ce0 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf01dbae0 con 0x7fddf00ab5d0 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf00ab5d0 0x7fddf01db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddee7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf00b9de0 0x7fddf014a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf00ab5d0 0x7fddf01db2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40458/0 (socket says 172.21.15.96:40458) 2024-09-16T06:46:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 -- 172.21.15.96:0/4289938032 learned_addr learned my addr 172.21.15.96:0/4289938032 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddee7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf00b9de0 0x7fddf014a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35974/0 (socket says 172.21.15.96:35974) 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 -- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0139ce0 msgr2=0x7fddf014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0139ce0 0x7fddf014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 -- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf00b9de0 msgr2=0x7fddf014a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf00b9de0 0x7fddf014a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 -- 172.21.15.96:0/4289938032 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8009420 con 0x7fddf00ab5d0 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddee7fc640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf00b9de0 0x7fddf014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddeeffd640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf00ab5d0 0x7fddf01db2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdde000c4d0 tx=0x7fdde000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fdde77fe640 1 -- 172.21.15.96:0/4289938032 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0005cf0 con 0x7fddf00ab5d0 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fdde77fe640 1 -- 172.21.15.96:0/4289938032 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0005e50 con 0x7fddf00ab5d0 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf01dbda0 con 0x7fddf00ab5d0 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fdde77fe640 1 -- 172.21.15.96:0/4289938032 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0007270 con 0x7fddf00ab5d0 2024-09-16T06:46:40.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf0145e80 con 0x7fddf00ab5d0 2024-09-16T06:46:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.951+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf00a60c0 con 0x7fddf00ab5d0 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fdde77fe640 1 -- 172.21.15.96:0/4289938032 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fdde00073d0 con 0x7fddf00ab5d0 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fdde77fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fdde77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fdde77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fdde77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fdde77fe640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fddd0097840 0x7fddd0099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fdde77fe640 1 -- 172.21.15.96:0/4289938032 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fdde00bf4b0 con 0x7fddf00ab5d0 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fddee7fc640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fddd0097840 0x7fddd0099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.955+0000 7fddee7fc640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fddd0097840 0x7fddd0099d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddd80ad000 tx=0x7fddd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:40.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:40.959+0000 7fdde77fe640 1 -- 172.21.15.96:0/4289938032 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdde008cc60 con 0x7fddf00ab5d0 2024-09-16T06:46:41.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.147+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fddf00a60c0 con 0x7fddf00ab5d0 2024-09-16T06:46:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.799+0000 7fdde77fe640 1 -- 172.21.15.96:0/4289938032 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdde00170c0 con 0x7fddf00ab5d0 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 10 mgrc shutdown 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fddd0097840 msgr2=0x7fddd0099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fddd0097840 0x7fddd0099d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fddd80ad000 tx=0x7fddd8008040 comp rx=0 tx=0).stop 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf00ab5d0 msgr2=0x7fddf01db2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf00ab5d0 0x7fddf01db2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdde000c4d0 tx=0x7fdde000c990 comp rx=0 tx=0).stop 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 shutdown_connections 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fddd0097840 0x7fddd0099d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fddf00b9de0 0x7fddf014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fddf0139ce0 0x7fddf014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:41.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 --2- 172.21.15.96:0/4289938032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddf00ab5d0 0x7fddf01db2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 >> 172.21.15.96:0/4289938032 conn(0x7fddf0072b70 msgr2=0x7fddf0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 shutdown_connections 2024-09-16T06:46:41.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.803+0000 7fddf55f2640 1 -- 172.21.15.96:0/4289938032 wait complete. 2024-09-16T06:46:41.825 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T06:46:41.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T06:46:41.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f3552912640 1 Processor -- start 2024-09-16T06:46:41.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f3552912640 1 -- start start 2024-09-16T06:46:41.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f3552912640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f354c06d8e0 0x7f354c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:41.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f3552912640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c070130 con 0x7f354c142a70 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f3552912640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c1435b0 con 0x7f354c0705c0 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f3552912640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c0a7840 con 0x7f354c06d8e0 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f354bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f354c06d8e0 0x7f354c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f354bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f354c06d8e0 0x7f354c06c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35982/0 (socket says 172.21.15.96:35982) 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f3550eaf640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f354c142a70 0x7f354c142ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:36268/0 (socket says 172.21.15.96:36268) 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f354bfff640 1 -- 172.21.15.96:0/1003865024 learned_addr learned my addr 172.21.15.96:0/1003865024 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f354bfff640 1 -- 172.21.15.96:0/1003865024 >> v1:172.21.15.134:6789/0 conn(0x7f354c0705c0 legacy=0x7f354c06fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f354bfff640 1 -- 172.21.15.96:0/1003865024 >> v1:172.21.15.96:6789/0 conn(0x7f354c142a70 legacy=0x7f354c142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f354bfff640 1 -- 172.21.15.96:0/1003865024 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0a7b00 con 0x7f354c06d8e0 2024-09-16T06:46:41.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.935+0000 7f354affd640 1 -- 172.21.15.96:0/1003865024 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036849967 0 0) 0x7f354c070130 con 0x7f354c142a70 2024-09-16T06:46:41.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f354bfff640 1 --2- 172.21.15.96:0/1003865024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c06d8e0 0x7f354c06c900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f353c009870 tx=0x7f353c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40373b34d3818d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:41.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f354affd640 1 -- 172.21.15.96:0/1003865024 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0ab600 con 0x7f354c06d8e0 2024-09-16T06:46:41.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f354affd640 1 -- 172.21.15.96:0/1003865024 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0a7050 con 0x7f354c06d8e0 2024-09-16T06:46:41.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f354affd640 1 -- 172.21.15.96:0/1003865024 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0ab980 con 0x7f354c06d8e0 2024-09-16T06:46:41.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 -- 172.21.15.96:0/1003865024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c06d8e0 msgr2=0x7f354c06c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:41.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 --2- 172.21.15.96:0/1003865024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c06d8e0 0x7f354c06c900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f353c009870 tx=0x7f353c01c500 comp rx=0 tx=0).stop 2024-09-16T06:46:41.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 -- 172.21.15.96:0/1003865024 shutdown_connections 2024-09-16T06:46:41.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 --2- 172.21.15.96:0/1003865024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c06d8e0 0x7f354c06c900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:41.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 -- 172.21.15.96:0/1003865024 >> 172.21.15.96:0/1003865024 conn(0x7f354c06f2c0 msgr2=0x7f354c0b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 -- 172.21.15.96:0/1003865024 shutdown_connections 2024-09-16T06:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 -- 172.21.15.96:0/1003865024 wait complete. 2024-09-16T06:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 Processor -- start 2024-09-16T06:46:41.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.939+0000 7f3552912640 1 -- start start 2024-09-16T06:46:41.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f354c06d8e0 0x7f354c146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f354c0705c0 0x7f354c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c142a70 0x7f354c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c147920 con 0x7f354c142a70 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c1df2b0 con 0x7f354c06d8e0 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c1df570 con 0x7f354c0705c0 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c142a70 0x7f354c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f354b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f354c0705c0 0x7f354c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c142a70 0x7f354c0b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35998/0 (socket says 172.21.15.96:35998) 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f354b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f354c0705c0 0x7f354c0b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:40474/0 (socket says 172.21.15.96:40474) 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 -- 172.21.15.96:0/2924495549 learned_addr learned my addr 172.21.15.96:0/2924495549 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 -- 172.21.15.96:0/2924495549 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f354c0705c0 msgr2=0x7f354c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f354c0705c0 0x7f354c0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:41.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 -- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f354c06d8e0 msgr2=0x7f354c146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f354c06d8e0 0x7f354c146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 -- 172.21.15.96:0/2924495549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0094d0 con 0x7f354c142a70 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3550eaf640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c142a70 0x7f354c0b22e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f354400c780 tx=0x7f354400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 1 -- 172.21.15.96:0/2924495549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400ce90 con 0x7f354c142a70 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 1 -- 172.21.15.96:0/2924495549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400a640 con 0x7f354c142a70 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c1df830 con 0x7f354c142a70 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 1 -- 172.21.15.96:0/2924495549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400a9d0 con 0x7f354c142a70 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c0b3180 con 0x7f354c142a70 2024-09-16T06:46:41.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c13b5f0 con 0x7f354c142a70 2024-09-16T06:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 1 -- 172.21.15.96:0/2924495549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f354400ab30 con 0x7f354c142a70 2024-09-16T06:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.943+0000 7f3548ff9640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3538097840 0x7f3538099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:41.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.947+0000 7f3548ff9640 1 -- 172.21.15.96:0/2924495549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f35440bf700 con 0x7f354c142a70 2024-09-16T06:46:41.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.947+0000 7f354bfff640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3538097840 0x7f3538099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:41.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.947+0000 7f354bfff640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3538097840 0x7f3538099d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f353c0ad000 tx=0x7f353c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:41.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:41.947+0000 7f3548ff9640 1 -- 172.21.15.96:0/2924495549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f354408ce80 con 0x7f354c142a70 2024-09-16T06:46:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f354c06c900 con 0x7f354c142a70 2024-09-16T06:46:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3548ff9640 1 -- 172.21.15.96:0/2924495549 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f3544018020 con 0x7f354c142a70 2024-09-16T06:46:42.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:42.127 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6809/2274498401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2274498401},{"type":"v1","addr":"172.21.15.96:6809","nonce":2274498401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6811/2101624097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2101624097},{"type":"v1","addr":"172.21.15.96:6811","nonce":2101624097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T06:46:39.151294+0000","modified":"2024-09-16T06:46:41.789469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6827/3093802738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3093802738},{"type":"v1","addr":"172.21.15.134:6827","nonce":3093802738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-16T06:46:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-09-16T06:46:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 10 mgrc shutdown 2024-09-16T06:46:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3538097840 msgr2=0x7f3538099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3538097840 0x7f3538099d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f353c0ad000 tx=0x7f353c008040 comp rx=0 tx=0).stop 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c142a70 msgr2=0x7f354c0b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c142a70 0x7f354c0b22e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f354400c780 tx=0x7f354400cc40 comp rx=0 tx=0).stop 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 shutdown_connections 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3538097840 0x7f3538099d00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.123+0000 7f3552912640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f354c142a70 0x7f354c0b22e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.127+0000 7f3552912640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f354c0705c0 0x7f354c0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.127+0000 7f3552912640 1 --2- 172.21.15.96:0/2924495549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f354c06d8e0 0x7f354c146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.127+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 >> 172.21.15.96:0/2924495549 conn(0x7f354c06f2c0 msgr2=0x7f354c141080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.127+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 shutdown_connections 2024-09-16T06:46:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.127+0000 7f3552912640 1 -- 172.21.15.96:0/2924495549 wait complete. 2024-09-16T06:46:42.144 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.243+0000 7f6d5d558640 1 Processor -- start 2024-09-16T06:46:42.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.243+0000 7f6d5d558640 1 -- start start 2024-09-16T06:46:42.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d5d558640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6d58142cf0 0x7f6d581430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d5d558640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6d5806e4b0 0x7f6d5806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d5d558640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d58147160 con 0x7f6d5806ce40 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d5d558640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d58147390 con 0x7f6d58142cf0 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d5d558640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d58147650 con 0x7f6d5806e4b0 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6d58142cf0 0x7f6d581430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6d58142cf0 0x7f6d581430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36012/0 (socket says 172.21.15.96:36012) 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 -- 172.21.15.96:0/1182934197 learned_addr learned my addr 172.21.15.96:0/1182934197 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d567fc640 1 --2- 172.21.15.96:0/1182934197 >> v2:172.21.15.134:3300/0 conn(0x7f6d5806e4b0 0x7f6d5806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 -- 172.21.15.96:0/1182934197 >> v2:172.21.15.134:3300/0 conn(0x7f6d5806e4b0 msgr2=0x7f6d5806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 --2- 172.21.15.96:0/1182934197 >> v2:172.21.15.134:3300/0 conn(0x7f6d5806e4b0 0x7f6d5806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 -- 172.21.15.96:0/1182934197 >> v1:172.21.15.134:6789/0 conn(0x7f6d5806ce40 legacy=0x7f6d58069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:42.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 -- 172.21.15.96:0/1182934197 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580a73e0 con 0x7f6d58142cf0 2024-09-16T06:46:42.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d56ffd640 1 --2- 172.21.15.96:0/1182934197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d581430d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d580b5180 tx=0x7f6d4801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8dc166c0f25d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d55ffb640 1 -- 172.21.15.96:0/1182934197 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480ab600 con 0x7f6d58142cf0 2024-09-16T06:46:42.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d55ffb640 1 -- 172.21.15.96:0/1182934197 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d480a7050 con 0x7f6d58142cf0 2024-09-16T06:46:42.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.247+0000 7f6d55ffb640 1 -- 172.21.15.96:0/1182934197 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480ab980 con 0x7f6d58142cf0 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1182934197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 msgr2=0x7f6d581430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1182934197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d581430d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d580b5180 tx=0x7f6d4801c430 comp rx=0 tx=0).stop 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1182934197 shutdown_connections 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1182934197 >> v2:172.21.15.134:3300/0 conn(0x7f6d5806e4b0 0x7f6d5806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1182934197 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d581430d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1182934197 >> 172.21.15.96:0/1182934197 conn(0x7f6d5806b8a0 msgr2=0x7f6d580a6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1182934197 shutdown_connections 2024-09-16T06:46:42.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1182934197 wait complete. 2024-09-16T06:46:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 Processor -- start 2024-09-16T06:46:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- start start 2024-09-16T06:46:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d5806ce40 0x7f6d58141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d5806e4b0 0x7f6d5813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d5813ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5813b460 con 0x7f6d58142cf0 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5813b720 con 0x7f6d5806ce40 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58141ac0 con 0x7f6d5806e4b0 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d5813ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d5813ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36022/0 (socket says 172.21.15.96:36022) 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d567fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d5806e4b0 0x7f6d5813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 -- 172.21.15.96:0/1702722484 learned_addr learned my addr 172.21.15.96:0/1702722484 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d56ffd640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d5806ce40 0x7f6d58141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 -- 172.21.15.96:0/1702722484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d5806e4b0 msgr2=0x7f6d5813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d5806e4b0 0x7f6d5813e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 -- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d5806ce40 msgr2=0x7f6d58141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d5806ce40 0x7f6d58141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 -- 172.21.15.96:0/1702722484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480094d0 con 0x7f6d58142cf0 2024-09-16T06:46:42.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d577fe640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d5813ed30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000b9e0 tx=0x7f6d5000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d3f7fe640 1 -- 172.21.15.96:0/1702722484 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5000cb20 con 0x7f6d58142cf0 2024-09-16T06:46:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d3f7fe640 1 -- 172.21.15.96:0/1702722484 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5000cc80 con 0x7f6d58142cf0 2024-09-16T06:46:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d3f7fe640 1 -- 172.21.15.96:0/1702722484 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50014680 con 0x7f6d58142cf0 2024-09-16T06:46:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d58141da0 con 0x7f6d58142cf0 2024-09-16T06:46:42.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5813ba60 con 0x7f6d58142cf0 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.251+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5806c900 con 0x7f6d58142cf0 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d3f7fe640 1 -- 172.21.15.96:0/1702722484 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f6d5001d3b0 con 0x7f6d58142cf0 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d3f7fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d3f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d3f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d3f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d3f7fe640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f6d44097840 0x7f6d44099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d3f7fe640 1 -- 172.21.15.96:0/1702722484 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f6d500bffd0 con 0x7f6d58142cf0 2024-09-16T06:46:42.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d56ffd640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f6d44097840 0x7f6d44099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.255+0000 7f6d56ffd640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f6d44097840 0x7f6d44099d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ad000 tx=0x7f6d48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.259+0000 7f6d3f7fe640 1 -- 172.21.15.96:0/1702722484 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d5008d6e0 con 0x7f6d58142cf0 2024-09-16T06:46:42.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.403+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d580a4fa0 con 0x7f6d58142cf0 2024-09-16T06:46:42.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d3f7fe640 1 -- 172.21.15.96:0/1702722484 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7f6d50019020 con 0x7f6d58142cf0 2024-09-16T06:46:42.410 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:42.410 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 10 mgrc shutdown 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f6d44097840 msgr2=0x7f6d44099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f6d44097840 0x7f6d44099d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ad000 tx=0x7f6d48008040 comp rx=0 tx=0).stop 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 msgr2=0x7f6d5813ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d5813ed30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000b9e0 tx=0x7f6d5000bea0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 shutdown_connections 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f6d44097840 0x7f6d44099d00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d58142cf0 0x7f6d5813ed30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d5806e4b0 0x7f6d5813e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 --2- 172.21.15.96:0/1702722484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d5806ce40 0x7f6d58141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 >> 172.21.15.96:0/1702722484 conn(0x7f6d5806b8a0 msgr2=0x7f6d580a87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 shutdown_connections 2024-09-16T06:46:42.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.407+0000 7f6d5d558640 1 -- 172.21.15.96:0/1702722484 wait complete. 2024-09-16T06:46:42.427 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-16T06:46:42.427 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T06:46:42.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.535+0000 7f69eeca3640 1 Processor -- start 2024-09-16T06:46:42.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.535+0000 7f69eeca3640 1 -- start start 2024-09-16T06:46:42.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eeca3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f69e80a9310 0x7f69e8147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eeca3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f69e80ab660 0x7f69e814de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eeca3640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80a96f0 con 0x7f69e80abe20 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eeca3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80aa380 con 0x7f69e80ab660 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eeca3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e8139ee0 con 0x7f69e80a9310 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f69e80ab660 0x7f69e814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f69e80ab660 0x7f69e814de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59232/0 (socket says 172.21.15.96:59232) 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 -- 172.21.15.96:0/1237875534 learned_addr learned my addr 172.21.15.96:0/1237875534 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eca3f640 1 --2- 172.21.15.96:0/1237875534 >> v2:172.21.15.134:3300/0 conn(0x7f69e80a9310 0x7f69e8147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 -- 172.21.15.96:0/1237875534 >> v2:172.21.15.134:3300/0 conn(0x7f69e80a9310 msgr2=0x7f69e8147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 --2- 172.21.15.96:0/1237875534 >> v2:172.21.15.134:3300/0 conn(0x7f69e80a9310 0x7f69e8147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 -- 172.21.15.96:0/1237875534 >> v1:172.21.15.134:6789/0 conn(0x7f69e80abe20 legacy=0x7f69e80aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:42.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 -- 172.21.15.96:0/1237875534 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8146b10 con 0x7f69e80ab660 2024-09-16T06:46:42.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69ed240640 1 --2- 172.21.15.96:0/1237875534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80ab660 0x7f69e814de40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009e80 tx=0x7f69e001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe4e45b310846ff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69e77fe640 1 -- 172.21.15.96:0/1237875534 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00a5620 con 0x7f69e80ab660 2024-09-16T06:46:42.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69e77fe640 1 -- 172.21.15.96:0/1237875534 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e00a5780 con 0x7f69e80ab660 2024-09-16T06:46:42.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69e77fe640 1 -- 172.21.15.96:0/1237875534 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00a5b10 con 0x7f69e80ab660 2024-09-16T06:46:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eeca3640 1 -- 172.21.15.96:0/1237875534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80ab660 msgr2=0x7f69e814de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.539+0000 7f69eeca3640 1 --2- 172.21.15.96:0/1237875534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80ab660 0x7f69e814de40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009e80 tx=0x7f69e001c850 comp rx=0 tx=0).stop 2024-09-16T06:46:42.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- 172.21.15.96:0/1237875534 shutdown_connections 2024-09-16T06:46:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 --2- 172.21.15.96:0/1237875534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80ab660 0x7f69e814de40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 --2- 172.21.15.96:0/1237875534 >> v2:172.21.15.134:3300/0 conn(0x7f69e80a9310 0x7f69e8147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- 172.21.15.96:0/1237875534 >> 172.21.15.96:0/1237875534 conn(0x7f69e806b4a0 msgr2=0x7f69e80a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- 172.21.15.96:0/1237875534 shutdown_connections 2024-09-16T06:46:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- 172.21.15.96:0/1237875534 wait complete. 2024-09-16T06:46:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 Processor -- start 2024-09-16T06:46:42.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- start start 2024-09-16T06:46:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f69e80a9310 0x7f69e80ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80abe20 0x7f69e80adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e806ddc0 0x7f69e806e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ae230 con 0x7f69e80abe20 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80b0d40 con 0x7f69e806ddc0 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ae6e0 con 0x7f69e80a9310 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80abe20 0x7f69e80adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eca3f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f69e80a9310 0x7f69e80ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80abe20 0x7f69e80adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59242/0 (socket says 172.21.15.96:59242) 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 -- 172.21.15.96:0/4187192583 learned_addr learned my addr 172.21.15.96:0/4187192583 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69ed240640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e806ddc0 0x7f69e806e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 -- 172.21.15.96:0/4187192583 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f69e80a9310 msgr2=0x7f69e80ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f69e80a9310 0x7f69e80ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 -- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e806ddc0 msgr2=0x7f69e806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e806ddc0 0x7f69e806e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 -- 172.21.15.96:0/4187192583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0009b30 con 0x7f69e80abe20 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e7fff640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80abe20 0x7f69e80adcf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69d800b440 tx=0x7f69d800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e57fa640 1 -- 172.21.15.96:0/4187192583 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8011830 con 0x7f69e80abe20 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e57fa640 1 -- 172.21.15.96:0/4187192583 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d8011990 con 0x7f69e80abe20 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69e57fa640 1 -- 172.21.15.96:0/4187192583 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8011d40 con 0x7f69e80abe20 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e8147a70 con 0x7f69e80abe20 2024-09-16T06:46:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e80ae480 con 0x7f69e80abe20 2024-09-16T06:46:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.543+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e80b7410 con 0x7f69e80abe20 2024-09-16T06:46:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69e57fa640 1 -- 172.21.15.96:0/4187192583 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f69d8004020 con 0x7f69e80abe20 2024-09-16T06:46:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69e57fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69e57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:42.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69e57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69e57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69e57fa640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f69c8097870 0x7f69c8099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69e57fa640 1 -- 172.21.15.96:0/4187192583 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f69d80bffa0 con 0x7f69e80abe20 2024-09-16T06:46:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69eca3f640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f69c8097870 0x7f69c8099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.547+0000 7f69eca3f640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f69c8097870 0x7f69c8099d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f69d000aae0 tx=0x7f69d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.551+0000 7f69e57fa640 1 -- 172.21.15.96:0/4187192583 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69d808d6b0 con 0x7f69e80abe20 2024-09-16T06:46:42.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.691+0000 7f69eeca3640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-09-16T06:46:42.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.691+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 --> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69e8147320 con 0x7f69c8097870 2024-09-16T06:46:42.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.735+0000 7f69e57fa640 1 -- 172.21.15.96:0/4187192583 <== mgr.4105 v2:172.21.15.134:6824/468510839 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271635 (secure 0 0 0) 0x7f69e8147320 con 0x7f69c8097870 2024-09-16T06:46:42.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.735+0000 7f69e57fa640 20 mgrc handle_command_reply tid 0 r 0 2024-09-16T06:46:42.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-09-16T06:46:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 10 mgrc shutdown 2024-09-16T06:46:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f69c8097870 msgr2=0x7f69c8099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f69c8097870 0x7f69c8099d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f69d000aae0 tx=0x7f69d0008040 comp rx=0 tx=0).stop 2024-09-16T06:46:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80abe20 msgr2=0x7f69e80adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80abe20 0x7f69e80adcf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69d800b440 tx=0x7f69d800b900 comp rx=0 tx=0).stop 2024-09-16T06:46:42.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 shutdown_connections 2024-09-16T06:46:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f69c8097870 0x7f69c8099d30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69e80abe20 0x7f69e80adcf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e806ddc0 0x7f69e806e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 --2- 172.21.15.96:0/4187192583 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f69e80a9310 0x7f69e80ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 >> 172.21.15.96:0/4187192583 conn(0x7f69e806b4a0 msgr2=0x7f69e8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 shutdown_connections 2024-09-16T06:46:42.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.739+0000 7f69eeca3640 1 -- 172.21.15.96:0/4187192583 wait complete. 2024-09-16T06:46:42.757 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T06:46:42.528132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592749,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109004,"kb_used_data":904,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377378356,"statfs":{"total":386547056640,"available":386435436544,"internally_reserved":0,"allocated":925696,"data_stored":1444894,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":6373,"internal_metadata":110618395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.758549"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380908+0000","last_change":"2024-09-16T06:46:39.197129+0000","last_active":"2024-09-16T06:46:39.380908+0000","last_peered":"2024-09-16T06:46:39.380908+0000","last_clean":"2024-09-16T06:46:39.380908+0000","last_became_active":"2024-09-16T06:46:39.196207+0000","last_became_peered":"2024-09-16T06:46:39.196207+0000","last_unstale":"2024-09-16T06:46:39.380908+0000","last_undegraded":"2024-09-16T06:46:39.380908+0000","last_fullsized":"2024-09-16T06:46:39.380908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:46.982408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374531+0000","last_change":"2024-09-16T06:46:39.181387+0000","last_active":"2024-09-16T06:46:39.374531+0000","last_peered":"2024-09-16T06:46:39.374531+0000","last_clean":"2024-09-16T06:46:39.374531+0000","last_became_active":"2024-09-16T06:46:39.181108+0000","last_became_peered":"2024-09-16T06:46:39.181108+0000","last_unstale":"2024-09-16T06:46:39.374531+0000","last_undegraded":"2024-09-16T06:46:39.374531+0000","last_fullsized":"2024-09-16T06:46:39.374531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:32:04.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374320+0000","last_change":"2024-09-16T06:46:39.183249+0000","last_active":"2024-09-16T06:46:39.374320+0000","last_peered":"2024-09-16T06:46:39.374320+0000","last_clean":"2024-09-16T06:46:39.374320+0000","last_became_active":"2024-09-16T06:46:39.181011+0000","last_became_peered":"2024-09-16T06:46:39.181011+0000","last_unstale":"2024-09-16T06:46:39.374320+0000","last_undegraded":"2024-09-16T06:46:39.374320+0000","last_fullsized":"2024-09-16T06:46:39.374320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:31.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574231+0000","last_change":"2024-09-16T06:46:39.200186+0000","last_active":"2024-09-16T06:46:39.574231+0000","last_peered":"2024-09-16T06:46:39.574231+0000","last_clean":"2024-09-16T06:46:39.574231+0000","last_became_active":"2024-09-16T06:46:39.199448+0000","last_became_peered":"2024-09-16T06:46:39.199448+0000","last_unstale":"2024-09-16T06:46:39.574231+0000","last_undegraded":"2024-09-16T06:46:39.574231+0000","last_fullsized":"2024-09-16T06:46:39.574231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380648+0000","last_change":"2024-09-16T06:46:39.178172+0000","last_active":"2024-09-16T06:46:39.380648+0000","last_peered":"2024-09-16T06:46:39.380648+0000","last_clean":"2024-09-16T06:46:39.380648+0000","last_became_active":"2024-09-16T06:46:39.177922+0000","last_became_peered":"2024-09-16T06:46:39.177922+0000","last_unstale":"2024-09-16T06:46:39.380648+0000","last_undegraded":"2024-09-16T06:46:39.380648+0000","last_fullsized":"2024-09-16T06:46:39.380648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379793+0000","last_change":"2024-09-16T06:46:39.174720+0000","last_active":"2024-09-16T06:46:39.379793+0000","last_peered":"2024-09-16T06:46:39.379793+0000","last_clean":"2024-09-16T06:46:39.379793+0000","last_became_active":"2024-09-16T06:46:39.173704+0000","last_became_peered":"2024-09-16T06:46:39.173704+0000","last_unstale":"2024-09-16T06:46:39.379793+0000","last_undegraded":"2024-09-16T06:46:39.379793+0000","last_fullsized":"2024-09-16T06:46:39.379793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:28:34.417850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379306+0000","last_change":"2024-09-16T06:46:39.190614+0000","last_active":"2024-09-16T06:46:39.379306+0000","last_peered":"2024-09-16T06:46:39.379306+0000","last_clean":"2024-09-16T06:46:39.379306+0000","last_became_active":"2024-09-16T06:46:39.179458+0000","last_became_peered":"2024-09-16T06:46:39.179458+0000","last_unstale":"2024-09-16T06:46:39.379306+0000","last_undegraded":"2024-09-16T06:46:39.379306+0000","last_fullsized":"2024-09-16T06:46:39.379306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:26:50.541794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373056+0000","last_change":"2024-09-16T06:46:39.185393+0000","last_active":"2024-09-16T06:46:39.373056+0000","last_peered":"2024-09-16T06:46:39.373056+0000","last_clean":"2024-09-16T06:46:39.373056+0000","last_became_active":"2024-09-16T06:46:39.185079+0000","last_became_peered":"2024-09-16T06:46:39.185079+0000","last_unstale":"2024-09-16T06:46:39.373056+0000","last_undegraded":"2024-09-16T06:46:39.373056+0000","last_fullsized":"2024-09-16T06:46:39.373056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380930+0000","last_change":"2024-09-16T06:46:39.197247+0000","last_active":"2024-09-16T06:46:39.380930+0000","last_peered":"2024-09-16T06:46:39.380930+0000","last_clean":"2024-09-16T06:46:39.380930+0000","last_became_active":"2024-09-16T06:46:39.196174+0000","last_became_peered":"2024-09-16T06:46:39.196174+0000","last_unstale":"2024-09-16T06:46:39.380930+0000","last_undegraded":"2024-09-16T06:46:39.380930+0000","last_fullsized":"2024-09-16T06:46:39.380930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:07.159072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574113+0000","last_change":"2024-09-16T06:46:39.193969+0000","last_active":"2024-09-16T06:46:39.574113+0000","last_peered":"2024-09-16T06:46:39.574113+0000","last_clean":"2024-09-16T06:46:39.574113+0000","last_became_active":"2024-09-16T06:46:39.192961+0000","last_became_peered":"2024-09-16T06:46:39.192961+0000","last_unstale":"2024-09-16T06:46:39.574113+0000","last_undegraded":"2024-09-16T06:46:39.574113+0000","last_fullsized":"2024-09-16T06:46:39.574113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573980+0000","last_change":"2024-09-16T06:46:39.184373+0000","last_active":"2024-09-16T06:46:39.573980+0000","last_peered":"2024-09-16T06:46:39.573980+0000","last_clean":"2024-09-16T06:46:39.573980+0000","last_became_active":"2024-09-16T06:46:39.184103+0000","last_became_peered":"2024-09-16T06:46:39.184103+0000","last_unstale":"2024-09-16T06:46:39.573980+0000","last_undegraded":"2024-09-16T06:46:39.573980+0000","last_fullsized":"2024-09-16T06:46:39.573980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:30.289208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380924+0000","last_change":"2024-09-16T06:46:39.191359+0000","last_active":"2024-09-16T06:46:39.380924+0000","last_peered":"2024-09-16T06:46:39.380924+0000","last_clean":"2024-09-16T06:46:39.380924+0000","last_became_active":"2024-09-16T06:46:39.190629+0000","last_became_peered":"2024-09-16T06:46:39.190629+0000","last_unstale":"2024-09-16T06:46:39.380924+0000","last_undegraded":"2024-09-16T06:46:39.380924+0000","last_fullsized":"2024-09-16T06:46:39.380924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:59.386136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379403+0000","last_change":"2024-09-16T06:46:39.197414+0000","last_active":"2024-09-16T06:46:39.379403+0000","last_peered":"2024-09-16T06:46:39.379403+0000","last_clean":"2024-09-16T06:46:39.379403+0000","last_became_active":"2024-09-16T06:46:39.196383+0000","last_became_peered":"2024-09-16T06:46:39.196383+0000","last_unstale":"2024-09-16T06:46:39.379403+0000","last_undegraded":"2024-09-16T06:46:39.379403+0000","last_fullsized":"2024-09-16T06:46:39.379403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:47.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373509+0000","last_change":"2024-09-16T06:46:39.186113+0000","last_active":"2024-09-16T06:46:39.373509+0000","last_peered":"2024-09-16T06:46:39.373509+0000","last_clean":"2024-09-16T06:46:39.373509+0000","last_became_active":"2024-09-16T06:46:39.185724+0000","last_became_peered":"2024-09-16T06:46:39.185724+0000","last_unstale":"2024-09-16T06:46:39.373509+0000","last_undegraded":"2024-09-16T06:46:39.373509+0000","last_fullsized":"2024-09-16T06:46:39.373509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373223+0000","last_change":"2024-09-16T06:46:39.181680+0000","last_active":"2024-09-16T06:46:39.373223+0000","last_peered":"2024-09-16T06:46:39.373223+0000","last_clean":"2024-09-16T06:46:39.373223+0000","last_became_active":"2024-09-16T06:46:39.181381+0000","last_became_peered":"2024-09-16T06:46:39.181381+0000","last_unstale":"2024-09-16T06:46:39.373223+0000","last_undegraded":"2024-09-16T06:46:39.373223+0000","last_fullsized":"2024-09-16T06:46:39.373223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:55.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373121+0000","last_change":"2024-09-16T06:46:39.183260+0000","last_active":"2024-09-16T06:46:39.373121+0000","last_peered":"2024-09-16T06:46:39.373121+0000","last_clean":"2024-09-16T06:46:39.373121+0000","last_became_active":"2024-09-16T06:46:39.182535+0000","last_became_peered":"2024-09-16T06:46:39.182535+0000","last_unstale":"2024-09-16T06:46:39.373121+0000","last_undegraded":"2024-09-16T06:46:39.373121+0000","last_fullsized":"2024-09-16T06:46:39.373121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574519+0000","last_change":"2024-09-16T06:46:39.196964+0000","last_active":"2024-09-16T06:46:39.574519+0000","last_peered":"2024-09-16T06:46:39.574519+0000","last_clean":"2024-09-16T06:46:39.574519+0000","last_became_active":"2024-09-16T06:46:39.193222+0000","last_became_peered":"2024-09-16T06:46:39.193222+0000","last_unstale":"2024-09-16T06:46:39.574519+0000","last_undegraded":"2024-09-16T06:46:39.574519+0000","last_fullsized":"2024-09-16T06:46:39.574519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382683+0000","last_change":"2024-09-16T06:46:39.195440+0000","last_active":"2024-09-16T06:46:39.382683+0000","last_peered":"2024-09-16T06:46:39.382683+0000","last_clean":"2024-09-16T06:46:39.382683+0000","last_became_active":"2024-09-16T06:46:39.195077+0000","last_became_peered":"2024-09-16T06:46:39.195077+0000","last_unstale":"2024-09-16T06:46:39.382683+0000","last_undegraded":"2024-09-16T06:46:39.382683+0000","last_fullsized":"2024-09-16T06:46:39.382683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:33.780991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380368+0000","last_change":"2024-09-16T06:46:39.199081+0000","last_active":"2024-09-16T06:46:39.380368+0000","last_peered":"2024-09-16T06:46:39.380368+0000","last_clean":"2024-09-16T06:46:39.380368+0000","last_became_active":"2024-09-16T06:46:39.198665+0000","last_became_peered":"2024-09-16T06:46:39.198665+0000","last_unstale":"2024-09-16T06:46:39.380368+0000","last_undegraded":"2024-09-16T06:46:39.380368+0000","last_fullsized":"2024-09-16T06:46:39.380368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:15.738622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574478+0000","last_change":"2024-09-16T06:46:39.189862+0000","last_active":"2024-09-16T06:46:39.574478+0000","last_peered":"2024-09-16T06:46:39.574478+0000","last_clean":"2024-09-16T06:46:39.574478+0000","last_became_active":"2024-09-16T06:46:39.189621+0000","last_became_peered":"2024-09-16T06:46:39.189621+0000","last_unstale":"2024-09-16T06:46:39.574478+0000","last_undegraded":"2024-09-16T06:46:39.574478+0000","last_fullsized":"2024-09-16T06:46:39.574478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374382+0000","last_change":"2024-09-16T06:46:39.166523+0000","last_active":"2024-09-16T06:46:39.374382+0000","last_peered":"2024-09-16T06:46:39.374382+0000","last_clean":"2024-09-16T06:46:39.374382+0000","last_became_active":"2024-09-16T06:46:39.166080+0000","last_became_peered":"2024-09-16T06:46:39.166080+0000","last_unstale":"2024-09-16T06:46:39.374382+0000","last_undegraded":"2024-09-16T06:46:39.374382+0000","last_fullsized":"2024-09-16T06:46:39.374382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572873+0000","last_change":"2024-09-16T06:46:39.192493+0000","last_active":"2024-09-16T06:46:39.572873+0000","last_peered":"2024-09-16T06:46:39.572873+0000","last_clean":"2024-09-16T06:46:39.572873+0000","last_became_active":"2024-09-16T06:46:39.191125+0000","last_became_peered":"2024-09-16T06:46:39.191125+0000","last_unstale":"2024-09-16T06:46:39.572873+0000","last_undegraded":"2024-09-16T06:46:39.572873+0000","last_fullsized":"2024-09-16T06:46:39.572873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379291+0000","last_change":"2024-09-16T06:46:39.201662+0000","last_active":"2024-09-16T06:46:39.379291+0000","last_peered":"2024-09-16T06:46:39.379291+0000","last_clean":"2024-09-16T06:46:39.379291+0000","last_became_active":"2024-09-16T06:46:39.201128+0000","last_became_peered":"2024-09-16T06:46:39.201128+0000","last_unstale":"2024-09-16T06:46:39.379291+0000","last_undegraded":"2024-09-16T06:46:39.379291+0000","last_fullsized":"2024-09-16T06:46:39.379291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373162+0000","last_change":"2024-09-16T06:46:39.165959+0000","last_active":"2024-09-16T06:46:39.373162+0000","last_peered":"2024-09-16T06:46:39.373162+0000","last_clean":"2024-09-16T06:46:39.373162+0000","last_became_active":"2024-09-16T06:46:39.165699+0000","last_became_peered":"2024-09-16T06:46:39.165699+0000","last_unstale":"2024-09-16T06:46:39.373162+0000","last_undegraded":"2024-09-16T06:46:39.373162+0000","last_fullsized":"2024-09-16T06:46:39.373162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574135+0000","last_change":"2024-09-16T06:46:39.192215+0000","last_active":"2024-09-16T06:46:39.574135+0000","last_peered":"2024-09-16T06:46:39.574135+0000","last_clean":"2024-09-16T06:46:39.574135+0000","last_became_active":"2024-09-16T06:46:39.190823+0000","last_became_peered":"2024-09-16T06:46:39.190823+0000","last_unstale":"2024-09-16T06:46:39.574135+0000","last_undegraded":"2024-09-16T06:46:39.574135+0000","last_fullsized":"2024-09-16T06:46:39.574135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574361+0000","last_change":"2024-09-16T06:46:39.191593+0000","last_active":"2024-09-16T06:46:39.574361+0000","last_peered":"2024-09-16T06:46:39.574361+0000","last_clean":"2024-09-16T06:46:39.574361+0000","last_became_active":"2024-09-16T06:46:39.191301+0000","last_became_peered":"2024-09-16T06:46:39.191301+0000","last_unstale":"2024-09-16T06:46:39.574361+0000","last_undegraded":"2024-09-16T06:46:39.574361+0000","last_fullsized":"2024-09-16T06:46:39.574361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374814+0000","last_change":"2024-09-16T06:46:39.166105+0000","last_active":"2024-09-16T06:46:39.374814+0000","last_peered":"2024-09-16T06:46:39.374814+0000","last_clean":"2024-09-16T06:46:39.374814+0000","last_became_active":"2024-09-16T06:46:39.165575+0000","last_became_peered":"2024-09-16T06:46:39.165575+0000","last_unstale":"2024-09-16T06:46:39.374814+0000","last_undegraded":"2024-09-16T06:46:39.374814+0000","last_fullsized":"2024-09-16T06:46:39.374814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575020+0000","last_change":"2024-09-16T06:46:39.191790+0000","last_active":"2024-09-16T06:46:39.575020+0000","last_peered":"2024-09-16T06:46:39.575020+0000","last_clean":"2024-09-16T06:46:39.575020+0000","last_became_active":"2024-09-16T06:46:39.191549+0000","last_became_peered":"2024-09-16T06:46:39.191549+0000","last_unstale":"2024-09-16T06:46:39.575020+0000","last_undegraded":"2024-09-16T06:46:39.575020+0000","last_fullsized":"2024-09-16T06:46:39.575020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380372+0000","last_change":"2024-09-16T06:46:39.176484+0000","last_active":"2024-09-16T06:46:39.380372+0000","last_peered":"2024-09-16T06:46:39.380372+0000","last_clean":"2024-09-16T06:46:39.380372+0000","last_became_active":"2024-09-16T06:46:39.176214+0000","last_became_peered":"2024-09-16T06:46:39.176214+0000","last_unstale":"2024-09-16T06:46:39.380372+0000","last_undegraded":"2024-09-16T06:46:39.380372+0000","last_fullsized":"2024-09-16T06:46:39.380372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573144+0000","last_change":"2024-09-16T06:46:39.188928+0000","last_active":"2024-09-16T06:46:39.573144+0000","last_peered":"2024-09-16T06:46:39.573144+0000","last_clean":"2024-09-16T06:46:39.573144+0000","last_became_active":"2024-09-16T06:46:39.188620+0000","last_became_peered":"2024-09-16T06:46:39.188620+0000","last_unstale":"2024-09-16T06:46:39.573144+0000","last_undegraded":"2024-09-16T06:46:39.573144+0000","last_fullsized":"2024-09-16T06:46:39.573144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379459+0000","last_change":"2024-09-16T06:46:39.200952+0000","last_active":"2024-09-16T06:46:39.379459+0000","last_peered":"2024-09-16T06:46:39.379459+0000","last_clean":"2024-09-16T06:46:39.379459+0000","last_became_active":"2024-09-16T06:46:39.197413+0000","last_became_peered":"2024-09-16T06:46:39.197413+0000","last_unstale":"2024-09-16T06:46:39.379459+0000","last_undegraded":"2024-09-16T06:46:39.379459+0000","last_fullsized":"2024-09-16T06:46:39.379459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373219+0000","last_change":"2024-09-16T06:46:39.183560+0000","last_active":"2024-09-16T06:46:39.373219+0000","last_peered":"2024-09-16T06:46:39.373219+0000","last_clean":"2024-09-16T06:46:39.373219+0000","last_became_active":"2024-09-16T06:46:39.182899+0000","last_became_peered":"2024-09-16T06:46:39.182899+0000","last_unstale":"2024-09-16T06:46:39.373219+0000","last_undegraded":"2024-09-16T06:46:39.373219+0000","last_fullsized":"2024-09-16T06:46:39.373219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381984+0000","last_change":"2024-09-16T06:46:39.200486+0000","last_active":"2024-09-16T06:46:39.381984+0000","last_peered":"2024-09-16T06:46:39.381984+0000","last_clean":"2024-09-16T06:46:39.381984+0000","last_became_active":"2024-09-16T06:46:39.198054+0000","last_became_peered":"2024-09-16T06:46:39.198054+0000","last_unstale":"2024-09-16T06:46:39.381984+0000","last_undegraded":"2024-09-16T06:46:39.381984+0000","last_fullsized":"2024-09-16T06:46:39.381984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381262+0000","last_change":"2024-09-16T06:46:38.819482+0000","last_active":"2024-09-16T06:46:39.381262+0000","last_peered":"2024-09-16T06:46:39.381262+0000","last_clean":"2024-09-16T06:46:39.381262+0000","last_became_active":"2024-09-16T06:46:38.818284+0000","last_became_peered":"2024-09-16T06:46:38.818284+0000","last_unstale":"2024-09-16T06:46:39.381262+0000","last_undegraded":"2024-09-16T06:46:39.381262+0000","last_fullsized":"2024-09-16T06:46:39.381262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:20.195598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382318+0000","last_change":"2024-09-16T06:46:39.195870+0000","last_active":"2024-09-16T06:46:39.382318+0000","last_peered":"2024-09-16T06:46:39.382318+0000","last_clean":"2024-09-16T06:46:39.382318+0000","last_became_active":"2024-09-16T06:46:39.194071+0000","last_became_peered":"2024-09-16T06:46:39.194071+0000","last_unstale":"2024-09-16T06:46:39.382318+0000","last_undegraded":"2024-09-16T06:46:39.382318+0000","last_fullsized":"2024-09-16T06:46:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:53.619215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380249+0000","last_change":"2024-09-16T06:46:38.827083+0000","last_active":"2024-09-16T06:46:39.380249+0000","last_peered":"2024-09-16T06:46:39.380249+0000","last_clean":"2024-09-16T06:46:39.380249+0000","last_became_active":"2024-09-16T06:46:38.826329+0000","last_became_peered":"2024-09-16T06:46:38.826329+0000","last_unstale":"2024-09-16T06:46:39.380249+0000","last_undegraded":"2024-09-16T06:46:39.380249+0000","last_fullsized":"2024-09-16T06:46:39.380249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:23.891217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382370+0000","last_change":"2024-09-16T06:46:39.200568+0000","last_active":"2024-09-16T06:46:39.382370+0000","last_peered":"2024-09-16T06:46:39.382370+0000","last_clean":"2024-09-16T06:46:39.382370+0000","last_became_active":"2024-09-16T06:46:39.197902+0000","last_became_peered":"2024-09-16T06:46:39.197902+0000","last_unstale":"2024-09-16T06:46:39.382370+0000","last_undegraded":"2024-09-16T06:46:39.382370+0000","last_fullsized":"2024-09-16T06:46:39.382370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373400+0000","last_change":"2024-09-16T06:46:38.831919+0000","last_active":"2024-09-16T06:46:39.373400+0000","last_peered":"2024-09-16T06:46:39.373400+0000","last_clean":"2024-09-16T06:46:39.373400+0000","last_became_active":"2024-09-16T06:46:38.831609+0000","last_became_peered":"2024-09-16T06:46:38.831609+0000","last_unstale":"2024-09-16T06:46:39.373400+0000","last_undegraded":"2024-09-16T06:46:39.373400+0000","last_fullsized":"2024-09-16T06:46:39.373400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382988+0000","last_change":"2024-09-16T06:46:39.200573+0000","last_active":"2024-09-16T06:46:39.382988+0000","last_peered":"2024-09-16T06:46:39.382988+0000","last_clean":"2024-09-16T06:46:39.382988+0000","last_became_active":"2024-09-16T06:46:39.198472+0000","last_became_peered":"2024-09-16T06:46:39.198472+0000","last_unstale":"2024-09-16T06:46:39.382988+0000","last_undegraded":"2024-09-16T06:46:39.382988+0000","last_fullsized":"2024-09-16T06:46:39.382988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373251+0000","last_change":"2024-09-16T06:46:38.827569+0000","last_active":"2024-09-16T06:46:39.373251+0000","last_peered":"2024-09-16T06:46:39.373251+0000","last_clean":"2024-09-16T06:46:39.373251+0000","last_became_active":"2024-09-16T06:46:38.827207+0000","last_became_peered":"2024-09-16T06:46:38.827207+0000","last_unstale":"2024-09-16T06:46:39.373251+0000","last_undegraded":"2024-09-16T06:46:39.373251+0000","last_fullsized":"2024-09-16T06:46:39.373251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:03.087447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374993+0000","last_change":"2024-09-16T06:46:38.838219+0000","last_active":"2024-09-16T06:46:39.374993+0000","last_peered":"2024-09-16T06:46:39.374993+0000","last_clean":"2024-09-16T06:46:39.374993+0000","last_became_active":"2024-09-16T06:46:38.837847+0000","last_became_peered":"2024-09-16T06:46:38.837847+0000","last_unstale":"2024-09-16T06:46:39.374993+0000","last_undegraded":"2024-09-16T06:46:39.374993+0000","last_fullsized":"2024-09-16T06:46:39.374993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:29.278281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379022+0000","last_change":"2024-09-16T06:46:39.178965+0000","last_active":"2024-09-16T06:46:39.379022+0000","last_peered":"2024-09-16T06:46:39.379022+0000","last_clean":"2024-09-16T06:46:39.379022+0000","last_became_active":"2024-09-16T06:46:39.178626+0000","last_became_peered":"2024-09-16T06:46:39.178626+0000","last_unstale":"2024-09-16T06:46:39.379022+0000","last_undegraded":"2024-09-16T06:46:39.379022+0000","last_fullsized":"2024-09-16T06:46:39.379022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:07.184854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374813+0000","last_change":"2024-09-16T06:46:38.810716+0000","last_active":"2024-09-16T06:46:39.374813+0000","last_peered":"2024-09-16T06:46:39.374813+0000","last_clean":"2024-09-16T06:46:39.374813+0000","last_became_active":"2024-09-16T06:46:38.810300+0000","last_became_peered":"2024-09-16T06:46:38.810300+0000","last_unstale":"2024-09-16T06:46:39.374813+0000","last_undegraded":"2024-09-16T06:46:39.374813+0000","last_fullsized":"2024-09-16T06:46:39.374813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:45.971482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573028+0000","last_change":"2024-09-16T06:46:39.200612+0000","last_active":"2024-09-16T06:46:39.573028+0000","last_peered":"2024-09-16T06:46:39.573028+0000","last_clean":"2024-09-16T06:46:39.573028+0000","last_became_active":"2024-09-16T06:46:39.200182+0000","last_became_peered":"2024-09-16T06:46:39.200182+0000","last_unstale":"2024-09-16T06:46:39.573028+0000","last_undegraded":"2024-09-16T06:46:39.573028+0000","last_fullsized":"2024-09-16T06:46:39.573028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374666+0000","last_change":"2024-09-16T06:46:38.828295+0000","last_active":"2024-09-16T06:46:39.374666+0000","last_peered":"2024-09-16T06:46:39.374666+0000","last_clean":"2024-09-16T06:46:39.374666+0000","last_became_active":"2024-09-16T06:46:38.827978+0000","last_became_peered":"2024-09-16T06:46:38.827978+0000","last_unstale":"2024-09-16T06:46:39.374666+0000","last_undegraded":"2024-09-16T06:46:39.374666+0000","last_fullsized":"2024-09-16T06:46:39.374666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:41.144933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373659+0000","last_change":"2024-09-16T06:46:39.165852+0000","last_active":"2024-09-16T06:46:39.373659+0000","last_peered":"2024-09-16T06:46:39.373659+0000","last_clean":"2024-09-16T06:46:39.373659+0000","last_became_active":"2024-09-16T06:46:39.165606+0000","last_became_peered":"2024-09-16T06:46:39.165606+0000","last_unstale":"2024-09-16T06:46:39.373659+0000","last_undegraded":"2024-09-16T06:46:39.373659+0000","last_fullsized":"2024-09-16T06:46:39.373659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374787+0000","last_change":"2024-09-16T06:46:38.791462+0000","last_active":"2024-09-16T06:46:39.374787+0000","last_peered":"2024-09-16T06:46:39.374787+0000","last_clean":"2024-09-16T06:46:39.374787+0000","last_became_active":"2024-09-16T06:46:38.790888+0000","last_became_peered":"2024-09-16T06:46:38.790888+0000","last_unstale":"2024-09-16T06:46:39.374787+0000","last_undegraded":"2024-09-16T06:46:39.374787+0000","last_fullsized":"2024-09-16T06:46:39.374787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380151+0000","last_change":"2024-09-16T06:46:39.194753+0000","last_active":"2024-09-16T06:46:39.380151+0000","last_peered":"2024-09-16T06:46:39.380151+0000","last_clean":"2024-09-16T06:46:39.380151+0000","last_became_active":"2024-09-16T06:46:39.194441+0000","last_became_peered":"2024-09-16T06:46:39.194441+0000","last_unstale":"2024-09-16T06:46:39.380151+0000","last_undegraded":"2024-09-16T06:46:39.380151+0000","last_fullsized":"2024-09-16T06:46:39.380151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:10.938486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381628+0000","last_change":"2024-09-16T06:46:38.828919+0000","last_active":"2024-09-16T06:46:39.381628+0000","last_peered":"2024-09-16T06:46:39.381628+0000","last_clean":"2024-09-16T06:46:39.381628+0000","last_became_active":"2024-09-16T06:46:38.827632+0000","last_became_peered":"2024-09-16T06:46:38.827632+0000","last_unstale":"2024-09-16T06:46:39.381628+0000","last_undegraded":"2024-09-16T06:46:39.381628+0000","last_fullsized":"2024-09-16T06:46:39.381628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574796+0000","last_change":"2024-09-16T06:46:39.199721+0000","last_active":"2024-09-16T06:46:39.574796+0000","last_peered":"2024-09-16T06:46:39.574796+0000","last_clean":"2024-09-16T06:46:39.574796+0000","last_became_active":"2024-09-16T06:46:39.198781+0000","last_became_peered":"2024-09-16T06:46:39.198781+0000","last_unstale":"2024-09-16T06:46:39.574796+0000","last_undegraded":"2024-09-16T06:46:39.574796+0000","last_fullsized":"2024-09-16T06:46:39.574796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373852+0000","last_change":"2024-09-16T06:46:38.827548+0000","last_active":"2024-09-16T06:46:39.373852+0000","last_peered":"2024-09-16T06:46:39.373852+0000","last_clean":"2024-09-16T06:46:39.373852+0000","last_became_active":"2024-09-16T06:46:38.827223+0000","last_became_peered":"2024-09-16T06:46:38.827223+0000","last_unstale":"2024-09-16T06:46:39.373852+0000","last_undegraded":"2024-09-16T06:46:39.373852+0000","last_fullsized":"2024-09-16T06:46:39.373852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:24.775378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374413+0000","last_change":"2024-09-16T06:46:39.182960+0000","last_active":"2024-09-16T06:46:39.374413+0000","last_peered":"2024-09-16T06:46:39.374413+0000","last_clean":"2024-09-16T06:46:39.374413+0000","last_became_active":"2024-09-16T06:46:39.182729+0000","last_became_peered":"2024-09-16T06:46:39.182729+0000","last_unstale":"2024-09-16T06:46:39.374413+0000","last_undegraded":"2024-09-16T06:46:39.374413+0000","last_fullsized":"2024-09-16T06:46:39.374413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379585+0000","last_change":"2024-09-16T06:46:38.828147+0000","last_active":"2024-09-16T06:46:39.379585+0000","last_peered":"2024-09-16T06:46:39.379585+0000","last_clean":"2024-09-16T06:46:39.379585+0000","last_became_active":"2024-09-16T06:46:38.810187+0000","last_became_peered":"2024-09-16T06:46:38.810187+0000","last_unstale":"2024-09-16T06:46:39.379585+0000","last_undegraded":"2024-09-16T06:46:39.379585+0000","last_fullsized":"2024-09-16T06:46:39.379585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:49.449347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380665+0000","last_change":"2024-09-16T06:46:39.188782+0000","last_active":"2024-09-16T06:46:39.380665+0000","last_peered":"2024-09-16T06:46:39.380665+0000","last_clean":"2024-09-16T06:46:39.380665+0000","last_became_active":"2024-09-16T06:46:39.188111+0000","last_became_peered":"2024-09-16T06:46:39.188111+0000","last_unstale":"2024-09-16T06:46:39.380665+0000","last_undegraded":"2024-09-16T06:46:39.380665+0000","last_fullsized":"2024-09-16T06:46:39.380665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:42.155860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379176+0000","last_change":"2024-09-16T06:46:38.843585+0000","last_active":"2024-09-16T06:46:39.379176+0000","last_peered":"2024-09-16T06:46:39.379176+0000","last_clean":"2024-09-16T06:46:39.379176+0000","last_became_active":"2024-09-16T06:46:38.842948+0000","last_became_peered":"2024-09-16T06:46:38.842948+0000","last_unstale":"2024-09-16T06:46:39.379176+0000","last_undegraded":"2024-09-16T06:46:39.379176+0000","last_fullsized":"2024-09-16T06:46:39.379176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:35.981497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574259+0000","last_change":"2024-09-16T06:46:39.205252+0000","last_active":"2024-09-16T06:46:39.574259+0000","last_peered":"2024-09-16T06:46:39.574259+0000","last_clean":"2024-09-16T06:46:39.574259+0000","last_became_active":"2024-09-16T06:46:39.204938+0000","last_became_peered":"2024-09-16T06:46:39.204938+0000","last_unstale":"2024-09-16T06:46:39.574259+0000","last_undegraded":"2024-09-16T06:46:39.574259+0000","last_fullsized":"2024-09-16T06:46:39.574259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.172541+0000","last_change":"2024-09-16T06:46:28.420745+0000","last_active":"2024-09-16T06:46:39.172541+0000","last_peered":"2024-09-16T06:46:39.172541+0000","last_clean":"2024-09-16T06:46:39.172541+0000","last_became_active":"2024-09-16T06:46:28.419090+0000","last_became_peered":"2024-09-16T06:46:28.419090+0000","last_unstale":"2024-09-16T06:46:39.172541+0000","last_undegraded":"2024-09-16T06:46:39.172541+0000","last_fullsized":"2024-09-16T06:46:39.172541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_clean_scrub_stamp":"2024-09-16T06:46:27.264921+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:28:51.531389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374566+0000","last_change":"2024-09-16T06:46:34.591498+0000","last_active":"2024-09-16T06:46:39.374566+0000","last_peered":"2024-09-16T06:46:39.374566+0000","last_clean":"2024-09-16T06:46:39.374566+0000","last_became_active":"2024-09-16T06:46:32.591383+0000","last_became_peered":"2024-09-16T06:46:32.591383+0000","last_unstale":"2024-09-16T06:46:39.374566+0000","last_undegraded":"2024-09-16T06:46:39.374566+0000","last_fullsized":"2024-09-16T06:46:39.374566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:53.253566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010025520000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380170+0000","last_change":"2024-09-16T06:46:38.820440+0000","last_active":"2024-09-16T06:46:39.380170+0000","last_peered":"2024-09-16T06:46:39.380170+0000","last_clean":"2024-09-16T06:46:39.380170+0000","last_became_active":"2024-09-16T06:46:38.818437+0000","last_became_peered":"2024-09-16T06:46:38.818437+0000","last_unstale":"2024-09-16T06:46:39.380170+0000","last_undegraded":"2024-09-16T06:46:39.380170+0000","last_fullsized":"2024-09-16T06:46:39.380170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:04.350191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374591+0000","last_change":"2024-09-16T06:46:39.182247+0000","last_active":"2024-09-16T06:46:39.374591+0000","last_peered":"2024-09-16T06:46:39.374591+0000","last_clean":"2024-09-16T06:46:39.374591+0000","last_became_active":"2024-09-16T06:46:39.181061+0000","last_became_peered":"2024-09-16T06:46:39.181061+0000","last_unstale":"2024-09-16T06:46:39.374591+0000","last_undegraded":"2024-09-16T06:46:39.374591+0000","last_fullsized":"2024-09-16T06:46:39.374591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:11.090727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373360+0000","last_change":"2024-09-16T06:46:34.591483+0000","last_active":"2024-09-16T06:46:39.373360+0000","last_peered":"2024-09-16T06:46:39.373360+0000","last_clean":"2024-09-16T06:46:39.373360+0000","last_became_active":"2024-09-16T06:46:32.587817+0000","last_became_peered":"2024-09-16T06:46:32.587817+0000","last_unstale":"2024-09-16T06:46:39.373360+0000","last_undegraded":"2024-09-16T06:46:39.373360+0000","last_fullsized":"2024-09-16T06:46:39.373360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010582059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573485+0000","last_change":"2024-09-16T06:46:38.837265+0000","last_active":"2024-09-16T06:46:39.573485+0000","last_peered":"2024-09-16T06:46:39.573485+0000","last_clean":"2024-09-16T06:46:39.573485+0000","last_became_active":"2024-09-16T06:46:38.832115+0000","last_became_peered":"2024-09-16T06:46:38.832115+0000","last_unstale":"2024-09-16T06:46:39.573485+0000","last_undegraded":"2024-09-16T06:46:39.573485+0000","last_fullsized":"2024-09-16T06:46:39.573485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:06.148145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382717+0000","last_change":"2024-09-16T06:46:39.200924+0000","last_active":"2024-09-16T06:46:39.382717+0000","last_peered":"2024-09-16T06:46:39.382717+0000","last_clean":"2024-09-16T06:46:39.382717+0000","last_became_active":"2024-09-16T06:46:39.200607+0000","last_became_peered":"2024-09-16T06:46:39.200607+0000","last_unstale":"2024-09-16T06:46:39.382717+0000","last_undegraded":"2024-09-16T06:46:39.382717+0000","last_fullsized":"2024-09-16T06:46:39.382717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379692+0000","last_change":"2024-09-16T06:46:34.715640+0000","last_active":"2024-09-16T06:46:39.379692+0000","last_peered":"2024-09-16T06:46:39.379692+0000","last_clean":"2024-09-16T06:46:39.379692+0000","last_became_active":"2024-09-16T06:46:32.593992+0000","last_became_peered":"2024-09-16T06:46:32.593992+0000","last_unstale":"2024-09-16T06:46:39.379692+0000","last_undegraded":"2024-09-16T06:46:39.379692+0000","last_fullsized":"2024-09-16T06:46:39.379692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:30.696024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051250899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572853+0000","last_change":"2024-09-16T06:46:38.831231+0000","last_active":"2024-09-16T06:46:39.572853+0000","last_peered":"2024-09-16T06:46:39.572853+0000","last_clean":"2024-09-16T06:46:39.572853+0000","last_became_active":"2024-09-16T06:46:38.830405+0000","last_became_peered":"2024-09-16T06:46:38.830405+0000","last_unstale":"2024-09-16T06:46:39.572853+0000","last_undegraded":"2024-09-16T06:46:39.572853+0000","last_fullsized":"2024-09-16T06:46:39.572853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574391+0000","last_change":"2024-09-16T06:46:39.199732+0000","last_active":"2024-09-16T06:46:39.574391+0000","last_peered":"2024-09-16T06:46:39.574391+0000","last_clean":"2024-09-16T06:46:39.574391+0000","last_became_active":"2024-09-16T06:46:39.199407+0000","last_became_peered":"2024-09-16T06:46:39.199407+0000","last_unstale":"2024-09-16T06:46:39.574391+0000","last_undegraded":"2024-09-16T06:46:39.574391+0000","last_fullsized":"2024-09-16T06:46:39.574391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373924+0000","last_change":"2024-09-16T06:46:34.592232+0000","last_active":"2024-09-16T06:46:39.373924+0000","last_peered":"2024-09-16T06:46:39.373924+0000","last_clean":"2024-09-16T06:46:39.373924+0000","last_became_active":"2024-09-16T06:46:32.584409+0000","last_became_peered":"2024-09-16T06:46:32.584409+0000","last_unstale":"2024-09-16T06:46:39.373924+0000","last_undegraded":"2024-09-16T06:46:39.373924+0000","last_fullsized":"2024-09-16T06:46:39.373924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001754603,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374471+0000","last_change":"2024-09-16T06:46:38.815767+0000","last_active":"2024-09-16T06:46:39.374471+0000","last_peered":"2024-09-16T06:46:39.374471+0000","last_clean":"2024-09-16T06:46:39.374471+0000","last_became_active":"2024-09-16T06:46:38.815553+0000","last_became_peered":"2024-09-16T06:46:38.815553+0000","last_unstale":"2024-09-16T06:46:39.374471+0000","last_undegraded":"2024-09-16T06:46:39.374471+0000","last_fullsized":"2024-09-16T06:46:39.374471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:03.610912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574733+0000","last_change":"2024-09-16T06:46:39.194564+0000","last_active":"2024-09-16T06:46:39.574733+0000","last_peered":"2024-09-16T06:46:39.574733+0000","last_clean":"2024-09-16T06:46:39.574733+0000","last_became_active":"2024-09-16T06:46:39.194168+0000","last_became_peered":"2024-09-16T06:46:39.194168+0000","last_unstale":"2024-09-16T06:46:39.574733+0000","last_undegraded":"2024-09-16T06:46:39.574733+0000","last_fullsized":"2024-09-16T06:46:39.574733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374696+0000","last_change":"2024-09-16T06:46:38.828799+0000","last_active":"2024-09-16T06:46:39.374696+0000","last_peered":"2024-09-16T06:46:39.374696+0000","last_clean":"2024-09-16T06:46:39.374696+0000","last_became_active":"2024-09-16T06:46:38.828136+0000","last_became_peered":"2024-09-16T06:46:38.828136+0000","last_unstale":"2024-09-16T06:46:39.374696+0000","last_undegraded":"2024-09-16T06:46:39.374696+0000","last_fullsized":"2024-09-16T06:46:39.374696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:33.286790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575150+0000","last_change":"2024-09-16T06:46:34.595510+0000","last_active":"2024-09-16T06:46:39.575150+0000","last_peered":"2024-09-16T06:46:39.575150+0000","last_clean":"2024-09-16T06:46:39.575150+0000","last_became_active":"2024-09-16T06:46:32.588966+0000","last_became_peered":"2024-09-16T06:46:32.588966+0000","last_unstale":"2024-09-16T06:46:39.575150+0000","last_undegraded":"2024-09-16T06:46:39.575150+0000","last_fullsized":"2024-09-16T06:46:39.575150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082793000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572993+0000","last_change":"2024-09-16T06:46:39.192738+0000","last_active":"2024-09-16T06:46:39.572993+0000","last_peered":"2024-09-16T06:46:39.572993+0000","last_clean":"2024-09-16T06:46:39.572993+0000","last_became_active":"2024-09-16T06:46:39.192227+0000","last_became_peered":"2024-09-16T06:46:39.192227+0000","last_unstale":"2024-09-16T06:46:39.572993+0000","last_undegraded":"2024-09-16T06:46:39.572993+0000","last_fullsized":"2024-09-16T06:46:39.572993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575058+0000","last_change":"2024-09-16T06:46:38.836459+0000","last_active":"2024-09-16T06:46:39.575058+0000","last_peered":"2024-09-16T06:46:39.575058+0000","last_clean":"2024-09-16T06:46:39.575058+0000","last_became_active":"2024-09-16T06:46:38.832248+0000","last_became_peered":"2024-09-16T06:46:38.832248+0000","last_unstale":"2024-09-16T06:46:39.575058+0000","last_undegraded":"2024-09-16T06:46:39.575058+0000","last_fullsized":"2024-09-16T06:46:39.575058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:56.866622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374900+0000","last_change":"2024-09-16T06:46:34.592592+0000","last_active":"2024-09-16T06:46:39.374900+0000","last_peered":"2024-09-16T06:46:39.374900+0000","last_clean":"2024-09-16T06:46:39.374900+0000","last_became_active":"2024-09-16T06:46:32.591488+0000","last_became_peered":"2024-09-16T06:46:32.591488+0000","last_unstale":"2024-09-16T06:46:39.374900+0000","last_undegraded":"2024-09-16T06:46:39.374900+0000","last_fullsized":"2024-09-16T06:46:39.374900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:46:25.248987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018038799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573210+0000","last_change":"2024-09-16T06:46:39.193260+0000","last_active":"2024-09-16T06:46:39.573210+0000","last_peered":"2024-09-16T06:46:39.573210+0000","last_clean":"2024-09-16T06:46:39.573210+0000","last_became_active":"2024-09-16T06:46:39.192979+0000","last_became_peered":"2024-09-16T06:46:39.192979+0000","last_unstale":"2024-09-16T06:46:39.573210+0000","last_undegraded":"2024-09-16T06:46:39.573210+0000","last_fullsized":"2024-09-16T06:46:39.573210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.383066+0000","last_change":"2024-09-16T06:46:38.843068+0000","last_active":"2024-09-16T06:46:39.383066+0000","last_peered":"2024-09-16T06:46:39.383066+0000","last_clean":"2024-09-16T06:46:39.383066+0000","last_became_active":"2024-09-16T06:46:38.842540+0000","last_became_peered":"2024-09-16T06:46:38.842540+0000","last_unstale":"2024-09-16T06:46:39.383066+0000","last_undegraded":"2024-09-16T06:46:39.383066+0000","last_fullsized":"2024-09-16T06:46:39.383066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574707+0000","last_change":"2024-09-16T06:46:34.595534+0000","last_active":"2024-09-16T06:46:39.574707+0000","last_peered":"2024-09-16T06:46:39.574707+0000","last_clean":"2024-09-16T06:46:39.574707+0000","last_became_active":"2024-09-16T06:46:32.591633+0000","last_became_peered":"2024-09-16T06:46:32.591633+0000","last_unstale":"2024-09-16T06:46:39.574707+0000","last_undegraded":"2024-09-16T06:46:39.574707+0000","last_fullsized":"2024-09-16T06:46:39.574707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084554300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379049+0000","last_change":"2024-09-16T06:46:39.198185+0000","last_active":"2024-09-16T06:46:39.379049+0000","last_peered":"2024-09-16T06:46:39.379049+0000","last_clean":"2024-09-16T06:46:39.379049+0000","last_became_active":"2024-09-16T06:46:39.197829+0000","last_became_peered":"2024-09-16T06:46:39.197829+0000","last_unstale":"2024-09-16T06:46:39.379049+0000","last_undegraded":"2024-09-16T06:46:39.379049+0000","last_fullsized":"2024-09-16T06:46:39.379049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.768079+0000","last_change":"2024-09-16T06:46:38.824771+0000","last_active":"2024-09-16T06:46:39.768079+0000","last_peered":"2024-09-16T06:46:39.768079+0000","last_clean":"2024-09-16T06:46:39.768079+0000","last_became_active":"2024-09-16T06:46:38.824096+0000","last_became_peered":"2024-09-16T06:46:38.824096+0000","last_unstale":"2024-09-16T06:46:39.768079+0000","last_undegraded":"2024-09-16T06:46:39.768079+0000","last_fullsized":"2024-09-16T06:46:39.768079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.375046+0000","last_change":"2024-09-16T06:46:34.592095+0000","last_active":"2024-09-16T06:46:39.375046+0000","last_peered":"2024-09-16T06:46:39.375046+0000","last_clean":"2024-09-16T06:46:39.375046+0000","last_became_active":"2024-09-16T06:46:32.585129+0000","last_became_peered":"2024-09-16T06:46:32.585129+0000","last_unstale":"2024-09-16T06:46:39.375046+0000","last_undegraded":"2024-09-16T06:46:39.375046+0000","last_fullsized":"2024-09-16T06:46:39.375046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:55.521712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015900179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379347+0000","last_change":"2024-09-16T06:46:39.187196+0000","last_active":"2024-09-16T06:46:39.379347+0000","last_peered":"2024-09-16T06:46:39.379347+0000","last_clean":"2024-09-16T06:46:39.379347+0000","last_became_active":"2024-09-16T06:46:39.184981+0000","last_became_peered":"2024-09-16T06:46:39.184981+0000","last_unstale":"2024-09-16T06:46:39.379347+0000","last_undegraded":"2024-09-16T06:46:39.379347+0000","last_fullsized":"2024-09-16T06:46:39.379347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:34.297717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379916+0000","last_change":"2024-09-16T06:46:39.185361+0000","last_active":"2024-09-16T06:46:39.379916+0000","last_peered":"2024-09-16T06:46:39.379916+0000","last_clean":"2024-09-16T06:46:39.379916+0000","last_became_active":"2024-09-16T06:46:39.185017+0000","last_became_peered":"2024-09-16T06:46:39.185017+0000","last_unstale":"2024-09-16T06:46:39.379916+0000","last_undegraded":"2024-09-16T06:46:39.379916+0000","last_fullsized":"2024-09-16T06:46:39.379916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:57.877549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374658+0000","last_change":"2024-09-16T06:46:38.804787+0000","last_active":"2024-09-16T06:46:39.374658+0000","last_peered":"2024-09-16T06:46:39.374658+0000","last_clean":"2024-09-16T06:46:39.374658+0000","last_became_active":"2024-09-16T06:46:38.804503+0000","last_became_peered":"2024-09-16T06:46:38.804503+0000","last_unstale":"2024-09-16T06:46:39.374658+0000","last_undegraded":"2024-09-16T06:46:39.374658+0000","last_fullsized":"2024-09-16T06:46:39.374658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:58.375210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573446+0000","last_change":"2024-09-16T06:46:39.185466+0000","last_active":"2024-09-16T06:46:39.573446+0000","last_peered":"2024-09-16T06:46:39.573446+0000","last_clean":"2024-09-16T06:46:39.573446+0000","last_became_active":"2024-09-16T06:46:39.185188+0000","last_became_peered":"2024-09-16T06:46:39.185188+0000","last_unstale":"2024-09-16T06:46:39.573446+0000","last_undegraded":"2024-09-16T06:46:39.573446+0000","last_fullsized":"2024-09-16T06:46:39.573446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381315+0000","last_change":"2024-09-16T06:46:38.826430+0000","last_active":"2024-09-16T06:46:39.381315+0000","last_peered":"2024-09-16T06:46:39.381315+0000","last_clean":"2024-09-16T06:46:39.381315+0000","last_became_active":"2024-09-16T06:46:38.825763+0000","last_became_peered":"2024-09-16T06:46:38.825763+0000","last_unstale":"2024-09-16T06:46:39.381315+0000","last_undegraded":"2024-09-16T06:46:39.381315+0000","last_fullsized":"2024-09-16T06:46:39.381315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:55.060544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374601+0000","last_change":"2024-09-16T06:46:38.828786+0000","last_active":"2024-09-16T06:46:39.374601+0000","last_peered":"2024-09-16T06:46:39.374601+0000","last_clean":"2024-09-16T06:46:39.374601+0000","last_became_active":"2024-09-16T06:46:38.827157+0000","last_became_peered":"2024-09-16T06:46:38.827157+0000","last_unstale":"2024-09-16T06:46:39.374601+0000","last_undegraded":"2024-09-16T06:46:39.374601+0000","last_fullsized":"2024-09-16T06:46:39.374601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:10:03.077384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379573+0000","last_change":"2024-09-16T06:46:39.195693+0000","last_active":"2024-09-16T06:46:39.379573+0000","last_peered":"2024-09-16T06:46:39.379573+0000","last_clean":"2024-09-16T06:46:39.379573+0000","last_became_active":"2024-09-16T06:46:39.180517+0000","last_became_peered":"2024-09-16T06:46:39.180517+0000","last_unstale":"2024-09-16T06:46:39.379573+0000","last_undegraded":"2024-09-16T06:46:39.379573+0000","last_fullsized":"2024-09-16T06:46:39.379573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:16.222534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574953+0000","last_change":"2024-09-16T06:46:38.842337+0000","last_active":"2024-09-16T06:46:39.574953+0000","last_peered":"2024-09-16T06:46:39.574953+0000","last_clean":"2024-09-16T06:46:39.574953+0000","last_became_active":"2024-09-16T06:46:38.841847+0000","last_became_peered":"2024-09-16T06:46:38.841847+0000","last_unstale":"2024-09-16T06:46:39.574953+0000","last_undegraded":"2024-09-16T06:46:39.574953+0000","last_fullsized":"2024-09-16T06:46:39.574953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.378908+0000","last_change":"2024-09-16T06:46:39.186930+0000","last_active":"2024-09-16T06:46:39.378908+0000","last_peered":"2024-09-16T06:46:39.378908+0000","last_clean":"2024-09-16T06:46:39.378908+0000","last_became_active":"2024-09-16T06:46:39.179564+0000","last_became_peered":"2024-09-16T06:46:39.179564+0000","last_unstale":"2024-09-16T06:46:39.378908+0000","last_undegraded":"2024-09-16T06:46:39.378908+0000","last_fullsized":"2024-09-16T06:46:39.378908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374942+0000","last_change":"2024-09-16T06:46:39.175212+0000","last_active":"2024-09-16T06:46:39.374942+0000","last_peered":"2024-09-16T06:46:39.374942+0000","last_clean":"2024-09-16T06:46:39.374942+0000","last_became_active":"2024-09-16T06:46:39.175010+0000","last_became_peered":"2024-09-16T06:46:39.175010+0000","last_unstale":"2024-09-16T06:46:39.374942+0000","last_undegraded":"2024-09-16T06:46:39.374942+0000","last_fullsized":"2024-09-16T06:46:39.374942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379170+0000","last_change":"2024-09-16T06:46:38.833982+0000","last_active":"2024-09-16T06:46:39.379170+0000","last_peered":"2024-09-16T06:46:39.379170+0000","last_clean":"2024-09-16T06:46:39.379170+0000","last_became_active":"2024-09-16T06:46:38.833337+0000","last_became_peered":"2024-09-16T06:46:38.833337+0000","last_unstale":"2024-09-16T06:46:39.379170+0000","last_undegraded":"2024-09-16T06:46:39.379170+0000","last_fullsized":"2024-09-16T06:46:39.379170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574266+0000","last_change":"2024-09-16T06:46:39.192612+0000","last_active":"2024-09-16T06:46:39.574266+0000","last_peered":"2024-09-16T06:46:39.574266+0000","last_clean":"2024-09-16T06:46:39.574266+0000","last_became_active":"2024-09-16T06:46:39.192292+0000","last_became_peered":"2024-09-16T06:46:39.192292+0000","last_unstale":"2024-09-16T06:46:39.574266+0000","last_undegraded":"2024-09-16T06:46:39.574266+0000","last_fullsized":"2024-09-16T06:46:39.574266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573272+0000","last_change":"2024-09-16T06:46:38.845796+0000","last_active":"2024-09-16T06:46:39.573272+0000","last_peered":"2024-09-16T06:46:39.573272+0000","last_clean":"2024-09-16T06:46:39.573272+0000","last_became_active":"2024-09-16T06:46:38.845067+0000","last_became_peered":"2024-09-16T06:46:38.845067+0000","last_unstale":"2024-09-16T06:46:39.573272+0000","last_undegraded":"2024-09-16T06:46:39.573272+0000","last_fullsized":"2024-09-16T06:46:39.573272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:46.841092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382233+0000","last_change":"2024-09-16T06:46:39.197876+0000","last_active":"2024-09-16T06:46:39.382233+0000","last_peered":"2024-09-16T06:46:39.382233+0000","last_clean":"2024-09-16T06:46:39.382233+0000","last_became_active":"2024-09-16T06:46:39.197577+0000","last_became_peered":"2024-09-16T06:46:39.197577+0000","last_unstale":"2024-09-16T06:46:39.382233+0000","last_undegraded":"2024-09-16T06:46:39.382233+0000","last_fullsized":"2024-09-16T06:46:39.382233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:38.035227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373743+0000","last_change":"2024-09-16T06:46:38.828782+0000","last_active":"2024-09-16T06:46:39.373743+0000","last_peered":"2024-09-16T06:46:39.373743+0000","last_clean":"2024-09-16T06:46:39.373743+0000","last_became_active":"2024-09-16T06:46:38.827397+0000","last_became_peered":"2024-09-16T06:46:38.827397+0000","last_unstale":"2024-09-16T06:46:39.373743+0000","last_undegraded":"2024-09-16T06:46:39.373743+0000","last_fullsized":"2024-09-16T06:46:39.373743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:13.559277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380975+0000","last_change":"2024-09-16T06:46:39.197981+0000","last_active":"2024-09-16T06:46:39.380975+0000","last_peered":"2024-09-16T06:46:39.380975+0000","last_clean":"2024-09-16T06:46:39.380975+0000","last_became_active":"2024-09-16T06:46:39.197563+0000","last_became_peered":"2024-09-16T06:46:39.197563+0000","last_unstale":"2024-09-16T06:46:39.380975+0000","last_undegraded":"2024-09-16T06:46:39.380975+0000","last_fullsized":"2024-09-16T06:46:39.380975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:04.098374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380879+0000","last_change":"2024-09-16T06:46:38.820441+0000","last_active":"2024-09-16T06:46:39.380879+0000","last_peered":"2024-09-16T06:46:39.380879+0000","last_clean":"2024-09-16T06:46:39.380879+0000","last_became_active":"2024-09-16T06:46:38.819557+0000","last_became_peered":"2024-09-16T06:46:38.819557+0000","last_unstale":"2024-09-16T06:46:39.380879+0000","last_undegraded":"2024-09-16T06:46:39.380879+0000","last_fullsized":"2024-09-16T06:46:39.380879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:53.345033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379674+0000","last_change":"2024-09-16T06:46:39.195683+0000","last_active":"2024-09-16T06:46:39.379674+0000","last_peered":"2024-09-16T06:46:39.379674+0000","last_clean":"2024-09-16T06:46:39.379674+0000","last_became_active":"2024-09-16T06:46:39.195257+0000","last_became_peered":"2024-09-16T06:46:39.195257+0000","last_unstale":"2024-09-16T06:46:39.379674+0000","last_undegraded":"2024-09-16T06:46:39.379674+0000","last_fullsized":"2024-09-16T06:46:39.379674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:45.567439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574872+0000","last_change":"2024-09-16T06:46:38.845647+0000","last_active":"2024-09-16T06:46:39.574872+0000","last_peered":"2024-09-16T06:46:39.574872+0000","last_clean":"2024-09-16T06:46:39.574872+0000","last_became_active":"2024-09-16T06:46:38.842456+0000","last_became_peered":"2024-09-16T06:46:38.842456+0000","last_unstale":"2024-09-16T06:46:39.574872+0000","last_undegraded":"2024-09-16T06:46:39.574872+0000","last_fullsized":"2024-09-16T06:46:39.574872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373566+0000","last_change":"2024-09-16T06:46:39.165157+0000","last_active":"2024-09-16T06:46:39.373566+0000","last_peered":"2024-09-16T06:46:39.373566+0000","last_clean":"2024-09-16T06:46:39.373566+0000","last_became_active":"2024-09-16T06:46:39.164481+0000","last_became_peered":"2024-09-16T06:46:39.164481+0000","last_unstale":"2024-09-16T06:46:39.373566+0000","last_undegraded":"2024-09-16T06:46:39.373566+0000","last_fullsized":"2024-09-16T06:46:39.373566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:33.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374569+0000","last_change":"2024-09-16T06:46:38.811325+0000","last_active":"2024-09-16T06:46:39.374569+0000","last_peered":"2024-09-16T06:46:39.374569+0000","last_clean":"2024-09-16T06:46:39.374569+0000","last_became_active":"2024-09-16T06:46:38.811045+0000","last_became_peered":"2024-09-16T06:46:38.811045+0000","last_unstale":"2024-09-16T06:46:39.374569+0000","last_undegraded":"2024-09-16T06:46:39.374569+0000","last_fullsized":"2024-09-16T06:46:39.374569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:09.927559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379772+0000","last_change":"2024-09-16T06:46:39.201473+0000","last_active":"2024-09-16T06:46:39.379772+0000","last_peered":"2024-09-16T06:46:39.379772+0000","last_clean":"2024-09-16T06:46:39.379772+0000","last_became_active":"2024-09-16T06:46:39.195802+0000","last_became_peered":"2024-09-16T06:46:39.195802+0000","last_unstale":"2024-09-16T06:46:39.379772+0000","last_undegraded":"2024-09-16T06:46:39.379772+0000","last_fullsized":"2024-09-16T06:46:39.379772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382822+0000","last_change":"2024-09-16T06:46:38.818893+0000","last_active":"2024-09-16T06:46:39.382822+0000","last_peered":"2024-09-16T06:46:39.382822+0000","last_clean":"2024-09-16T06:46:39.382822+0000","last_became_active":"2024-09-16T06:46:38.818126+0000","last_became_peered":"2024-09-16T06:46:38.818126+0000","last_unstale":"2024-09-16T06:46:39.382822+0000","last_undegraded":"2024-09-16T06:46:39.382822+0000","last_fullsized":"2024-09-16T06:46:39.382822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:07:21.946452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373312+0000","last_change":"2024-09-16T06:46:39.181737+0000","last_active":"2024-09-16T06:46:39.373312+0000","last_peered":"2024-09-16T06:46:39.373312+0000","last_clean":"2024-09-16T06:46:39.373312+0000","last_became_active":"2024-09-16T06:46:39.181022+0000","last_became_peered":"2024-09-16T06:46:39.181022+0000","last_unstale":"2024-09-16T06:46:39.373312+0000","last_undegraded":"2024-09-16T06:46:39.373312+0000","last_fullsized":"2024-09-16T06:46:39.373312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574823+0000","last_change":"2024-09-16T06:46:38.845870+0000","last_active":"2024-09-16T06:46:39.574823+0000","last_peered":"2024-09-16T06:46:39.574823+0000","last_clean":"2024-09-16T06:46:39.574823+0000","last_became_active":"2024-09-16T06:46:38.837200+0000","last_became_peered":"2024-09-16T06:46:38.837200+0000","last_unstale":"2024-09-16T06:46:39.574823+0000","last_undegraded":"2024-09-16T06:46:39.574823+0000","last_fullsized":"2024-09-16T06:46:39.574823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":65043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":657453,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":655840,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":66558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T06:46:42.762 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T06:46:42.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.911+0000 7fc39cd4e640 1 Processor -- start 2024-09-16T06:46:42.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39cd4e640 1 -- start start 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39cd4e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc39814cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39cd4e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3981449e0 con 0x7fc3980a5100 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39cd4e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3980a54e0 con 0x7fc3980a40e0 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39cd4e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39806d7b0 con 0x7fc398137b20 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc396d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc39814cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc3980a5100 0x7fc39806e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52354/0 (socket says 172.21.15.96:52354) 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc396d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc39814cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:55976/0 (socket says 172.21.15.96:55976) 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39659c640 1 -- 172.21.15.96:0/3572567037 learned_addr learned my addr 172.21.15.96:0/3572567037 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39559a640 1 -- 172.21.15.96:0/3572567037 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245254399 0 0) 0x7fc3981449e0 con 0x7fc3980a5100 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39559a640 1 -- 172.21.15.96:0/3572567037 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc380003530 con 0x7fc3980a5100 2024-09-16T06:46:42.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc396d9d640 1 -- 172.21.15.96:0/3572567037 >> v1:172.21.15.134:6789/0 conn(0x7fc3980a40e0 legacy=0x7fc398144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc396d9d640 1 -- 172.21.15.96:0/3572567037 >> v1:172.21.15.96:6789/0 conn(0x7fc3980a5100 legacy=0x7fc39806e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc396d9d640 1 -- 172.21.15.96:0/3572567037 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398144c10 con 0x7fc398137b20 2024-09-16T06:46:42.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc396d9d640 1 --2- 172.21.15.96:0/3572567037 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc39814cd20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3880097f0 tx=0x7fc38801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19646fe7bc4c6cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39559a640 1 -- 172.21.15.96:0/3572567037 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3880a6040 con 0x7fc398137b20 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39559a640 1 -- 172.21.15.96:0/3572567037 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3880aa600 con 0x7fc398137b20 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.915+0000 7fc39559a640 1 -- 172.21.15.96:0/3572567037 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3880aa990 con 0x7fc398137b20 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/3572567037 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 msgr2=0x7fc39814cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/3572567037 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc39814cd20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3880097f0 tx=0x7fc38801c440 comp rx=0 tx=0).stop 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/3572567037 shutdown_connections 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/3572567037 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc39814cd20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/3572567037 >> 172.21.15.96:0/3572567037 conn(0x7fc39806b8a0 msgr2=0x7fc3980a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/3572567037 shutdown_connections 2024-09-16T06:46:42.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/3572567037 wait complete. 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 Processor -- start 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- start start 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3980a40e0 0x7fc3980b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980a5100 0x7fc39812bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc3980a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39812c6d0 con 0x7fc3980a5100 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980b2db0 con 0x7fc3980a40e0 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39814c5d0 con 0x7fc398137b20 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc396d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc3980a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980a5100 0x7fc39812bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc396d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc3980a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:55984/0 (socket says 172.21.15.96:55984) 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980a5100 0x7fc39812bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59254/0 (socket says 172.21.15.96:59254) 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc396d9d640 1 -- 172.21.15.96:0/4226270135 learned_addr learned my addr 172.21.15.96:0/4226270135 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39659c640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3980a40e0 0x7fc3980b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 -- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 msgr2=0x7fc3980a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc3980a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 -- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3980a40e0 msgr2=0x7fc3980b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3980a40e0 0x7fc3980b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 -- 172.21.15.96:0/4226270135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388009420 con 0x7fc3980a5100 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc396d9d640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc3980a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc395d9b640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980a5100 0x7fc39812bc50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3980a44c0 tx=0x7fc38c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc386ffd640 1 -- 172.21.15.96:0/4226270135 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0052d0 con 0x7fc3980a5100 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc386ffd640 1 -- 172.21.15.96:0/4226270135 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c005430 con 0x7fc3980a5100 2024-09-16T06:46:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3980a5b10 con 0x7fc3980a5100 2024-09-16T06:46:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc386ffd640 1 -- 172.21.15.96:0/4226270135 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c003820 con 0x7fc3980a5100 2024-09-16T06:46:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39806ebe0 con 0x7fc3980a5100 2024-09-16T06:46:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.919+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc398144ed0 con 0x7fc3980a5100 2024-09-16T06:46:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc386ffd640 1 -- 172.21.15.96:0/4226270135 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fc38c003980 con 0x7fc3980a5100 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc386ffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc386ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc386ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc386ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc386ffd640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc378097870 0x7fc378099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc386ffd640 1 -- 172.21.15.96:0/4226270135 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fc38c0bf5f0 con 0x7fc3980a5100 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc39659c640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc378097870 0x7fc378099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.923+0000 7fc39659c640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc378097870 0x7fc378099d30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc390001570 tx=0x7fc390009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:42.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:42.927+0000 7fc386ffd640 1 -- 172.21.15.96:0/4226270135 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc38c08cd90 con 0x7fc3980a5100 2024-09-16T06:46:43.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.067+0000 7fc39cd4e640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-09-16T06:46:43.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.067+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 --> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3980a2d00 con 0x7fc378097870 2024-09-16T06:46:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.087+0000 7fc386ffd640 1 -- 172.21.15.96:0/4226270135 <== mgr.4105 v2:172.21.15.134:6824/468510839 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271635 (secure 0 0 0) 0x7fc3980a2d00 con 0x7fc378097870 2024-09-16T06:46:43.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.087+0000 7fc386ffd640 20 mgrc handle_command_reply tid 0 r 0 2024-09-16T06:46:43.091 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:43.093 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-09-16T06:46:43.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 10 mgrc shutdown 2024-09-16T06:46:43.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc378097870 msgr2=0x7fc378099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc378097870 0x7fc378099d30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc390001570 tx=0x7fc390009040 comp rx=0 tx=0).stop 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980a5100 msgr2=0x7fc39812bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980a5100 0x7fc39812bc50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3980a44c0 tx=0x7fc38c00c870 comp rx=0 tx=0).stop 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 shutdown_connections 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc378097870 0x7fc378099d30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3980a5100 0x7fc39812bc50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc398137b20 0x7fc3980a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 --2- 172.21.15.96:0/4226270135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3980a40e0 0x7fc3980b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 >> 172.21.15.96:0/4226270135 conn(0x7fc39806b8a0 msgr2=0x7fc39806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 shutdown_connections 2024-09-16T06:46:43.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.091+0000 7fc39cd4e640 1 -- 172.21.15.96:0/4226270135 wait complete. 2024-09-16T06:46:43.109 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T06:46:42.528132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592749,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109004,"kb_used_data":904,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377378356,"statfs":{"total":386547056640,"available":386435436544,"internally_reserved":0,"allocated":925696,"data_stored":1444894,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":6373,"internal_metadata":110618395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.758549"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380908+0000","last_change":"2024-09-16T06:46:39.197129+0000","last_active":"2024-09-16T06:46:39.380908+0000","last_peered":"2024-09-16T06:46:39.380908+0000","last_clean":"2024-09-16T06:46:39.380908+0000","last_became_active":"2024-09-16T06:46:39.196207+0000","last_became_peered":"2024-09-16T06:46:39.196207+0000","last_unstale":"2024-09-16T06:46:39.380908+0000","last_undegraded":"2024-09-16T06:46:39.380908+0000","last_fullsized":"2024-09-16T06:46:39.380908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:46.982408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374531+0000","last_change":"2024-09-16T06:46:39.181387+0000","last_active":"2024-09-16T06:46:39.374531+0000","last_peered":"2024-09-16T06:46:39.374531+0000","last_clean":"2024-09-16T06:46:39.374531+0000","last_became_active":"2024-09-16T06:46:39.181108+0000","last_became_peered":"2024-09-16T06:46:39.181108+0000","last_unstale":"2024-09-16T06:46:39.374531+0000","last_undegraded":"2024-09-16T06:46:39.374531+0000","last_fullsized":"2024-09-16T06:46:39.374531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:32:04.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374320+0000","last_change":"2024-09-16T06:46:39.183249+0000","last_active":"2024-09-16T06:46:39.374320+0000","last_peered":"2024-09-16T06:46:39.374320+0000","last_clean":"2024-09-16T06:46:39.374320+0000","last_became_active":"2024-09-16T06:46:39.181011+0000","last_became_peered":"2024-09-16T06:46:39.181011+0000","last_unstale":"2024-09-16T06:46:39.374320+0000","last_undegraded":"2024-09-16T06:46:39.374320+0000","last_fullsized":"2024-09-16T06:46:39.374320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:31.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574231+0000","last_change":"2024-09-16T06:46:39.200186+0000","last_active":"2024-09-16T06:46:39.574231+0000","last_peered":"2024-09-16T06:46:39.574231+0000","last_clean":"2024-09-16T06:46:39.574231+0000","last_became_active":"2024-09-16T06:46:39.199448+0000","last_became_peered":"2024-09-16T06:46:39.199448+0000","last_unstale":"2024-09-16T06:46:39.574231+0000","last_undegraded":"2024-09-16T06:46:39.574231+0000","last_fullsized":"2024-09-16T06:46:39.574231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380648+0000","last_change":"2024-09-16T06:46:39.178172+0000","last_active":"2024-09-16T06:46:39.380648+0000","last_peered":"2024-09-16T06:46:39.380648+0000","last_clean":"2024-09-16T06:46:39.380648+0000","last_became_active":"2024-09-16T06:46:39.177922+0000","last_became_peered":"2024-09-16T06:46:39.177922+0000","last_unstale":"2024-09-16T06:46:39.380648+0000","last_undegraded":"2024-09-16T06:46:39.380648+0000","last_fullsized":"2024-09-16T06:46:39.380648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379793+0000","last_change":"2024-09-16T06:46:39.174720+0000","last_active":"2024-09-16T06:46:39.379793+0000","last_peered":"2024-09-16T06:46:39.379793+0000","last_clean":"2024-09-16T06:46:39.379793+0000","last_became_active":"2024-09-16T06:46:39.173704+0000","last_became_peered":"2024-09-16T06:46:39.173704+0000","last_unstale":"2024-09-16T06:46:39.379793+0000","last_undegraded":"2024-09-16T06:46:39.379793+0000","last_fullsized":"2024-09-16T06:46:39.379793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:28:34.417850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379306+0000","last_change":"2024-09-16T06:46:39.190614+0000","last_active":"2024-09-16T06:46:39.379306+0000","last_peered":"2024-09-16T06:46:39.379306+0000","last_clean":"2024-09-16T06:46:39.379306+0000","last_became_active":"2024-09-16T06:46:39.179458+0000","last_became_peered":"2024-09-16T06:46:39.179458+0000","last_unstale":"2024-09-16T06:46:39.379306+0000","last_undegraded":"2024-09-16T06:46:39.379306+0000","last_fullsized":"2024-09-16T06:46:39.379306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:26:50.541794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373056+0000","last_change":"2024-09-16T06:46:39.185393+0000","last_active":"2024-09-16T06:46:39.373056+0000","last_peered":"2024-09-16T06:46:39.373056+0000","last_clean":"2024-09-16T06:46:39.373056+0000","last_became_active":"2024-09-16T06:46:39.185079+0000","last_became_peered":"2024-09-16T06:46:39.185079+0000","last_unstale":"2024-09-16T06:46:39.373056+0000","last_undegraded":"2024-09-16T06:46:39.373056+0000","last_fullsized":"2024-09-16T06:46:39.373056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380930+0000","last_change":"2024-09-16T06:46:39.197247+0000","last_active":"2024-09-16T06:46:39.380930+0000","last_peered":"2024-09-16T06:46:39.380930+0000","last_clean":"2024-09-16T06:46:39.380930+0000","last_became_active":"2024-09-16T06:46:39.196174+0000","last_became_peered":"2024-09-16T06:46:39.196174+0000","last_unstale":"2024-09-16T06:46:39.380930+0000","last_undegraded":"2024-09-16T06:46:39.380930+0000","last_fullsized":"2024-09-16T06:46:39.380930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:07.159072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574113+0000","last_change":"2024-09-16T06:46:39.193969+0000","last_active":"2024-09-16T06:46:39.574113+0000","last_peered":"2024-09-16T06:46:39.574113+0000","last_clean":"2024-09-16T06:46:39.574113+0000","last_became_active":"2024-09-16T06:46:39.192961+0000","last_became_peered":"2024-09-16T06:46:39.192961+0000","last_unstale":"2024-09-16T06:46:39.574113+0000","last_undegraded":"2024-09-16T06:46:39.574113+0000","last_fullsized":"2024-09-16T06:46:39.574113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573980+0000","last_change":"2024-09-16T06:46:39.184373+0000","last_active":"2024-09-16T06:46:39.573980+0000","last_peered":"2024-09-16T06:46:39.573980+0000","last_clean":"2024-09-16T06:46:39.573980+0000","last_became_active":"2024-09-16T06:46:39.184103+0000","last_became_peered":"2024-09-16T06:46:39.184103+0000","last_unstale":"2024-09-16T06:46:39.573980+0000","last_undegraded":"2024-09-16T06:46:39.573980+0000","last_fullsized":"2024-09-16T06:46:39.573980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:30.289208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380924+0000","last_change":"2024-09-16T06:46:39.191359+0000","last_active":"2024-09-16T06:46:39.380924+0000","last_peered":"2024-09-16T06:46:39.380924+0000","last_clean":"2024-09-16T06:46:39.380924+0000","last_became_active":"2024-09-16T06:46:39.190629+0000","last_became_peered":"2024-09-16T06:46:39.190629+0000","last_unstale":"2024-09-16T06:46:39.380924+0000","last_undegraded":"2024-09-16T06:46:39.380924+0000","last_fullsized":"2024-09-16T06:46:39.380924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:59.386136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379403+0000","last_change":"2024-09-16T06:46:39.197414+0000","last_active":"2024-09-16T06:46:39.379403+0000","last_peered":"2024-09-16T06:46:39.379403+0000","last_clean":"2024-09-16T06:46:39.379403+0000","last_became_active":"2024-09-16T06:46:39.196383+0000","last_became_peered":"2024-09-16T06:46:39.196383+0000","last_unstale":"2024-09-16T06:46:39.379403+0000","last_undegraded":"2024-09-16T06:46:39.379403+0000","last_fullsized":"2024-09-16T06:46:39.379403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:47.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373509+0000","last_change":"2024-09-16T06:46:39.186113+0000","last_active":"2024-09-16T06:46:39.373509+0000","last_peered":"2024-09-16T06:46:39.373509+0000","last_clean":"2024-09-16T06:46:39.373509+0000","last_became_active":"2024-09-16T06:46:39.185724+0000","last_became_peered":"2024-09-16T06:46:39.185724+0000","last_unstale":"2024-09-16T06:46:39.373509+0000","last_undegraded":"2024-09-16T06:46:39.373509+0000","last_fullsized":"2024-09-16T06:46:39.373509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373223+0000","last_change":"2024-09-16T06:46:39.181680+0000","last_active":"2024-09-16T06:46:39.373223+0000","last_peered":"2024-09-16T06:46:39.373223+0000","last_clean":"2024-09-16T06:46:39.373223+0000","last_became_active":"2024-09-16T06:46:39.181381+0000","last_became_peered":"2024-09-16T06:46:39.181381+0000","last_unstale":"2024-09-16T06:46:39.373223+0000","last_undegraded":"2024-09-16T06:46:39.373223+0000","last_fullsized":"2024-09-16T06:46:39.373223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:55.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373121+0000","last_change":"2024-09-16T06:46:39.183260+0000","last_active":"2024-09-16T06:46:39.373121+0000","last_peered":"2024-09-16T06:46:39.373121+0000","last_clean":"2024-09-16T06:46:39.373121+0000","last_became_active":"2024-09-16T06:46:39.182535+0000","last_became_peered":"2024-09-16T06:46:39.182535+0000","last_unstale":"2024-09-16T06:46:39.373121+0000","last_undegraded":"2024-09-16T06:46:39.373121+0000","last_fullsized":"2024-09-16T06:46:39.373121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574519+0000","last_change":"2024-09-16T06:46:39.196964+0000","last_active":"2024-09-16T06:46:39.574519+0000","last_peered":"2024-09-16T06:46:39.574519+0000","last_clean":"2024-09-16T06:46:39.574519+0000","last_became_active":"2024-09-16T06:46:39.193222+0000","last_became_peered":"2024-09-16T06:46:39.193222+0000","last_unstale":"2024-09-16T06:46:39.574519+0000","last_undegraded":"2024-09-16T06:46:39.574519+0000","last_fullsized":"2024-09-16T06:46:39.574519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382683+0000","last_change":"2024-09-16T06:46:39.195440+0000","last_active":"2024-09-16T06:46:39.382683+0000","last_peered":"2024-09-16T06:46:39.382683+0000","last_clean":"2024-09-16T06:46:39.382683+0000","last_became_active":"2024-09-16T06:46:39.195077+0000","last_became_peered":"2024-09-16T06:46:39.195077+0000","last_unstale":"2024-09-16T06:46:39.382683+0000","last_undegraded":"2024-09-16T06:46:39.382683+0000","last_fullsized":"2024-09-16T06:46:39.382683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:33.780991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380368+0000","last_change":"2024-09-16T06:46:39.199081+0000","last_active":"2024-09-16T06:46:39.380368+0000","last_peered":"2024-09-16T06:46:39.380368+0000","last_clean":"2024-09-16T06:46:39.380368+0000","last_became_active":"2024-09-16T06:46:39.198665+0000","last_became_peered":"2024-09-16T06:46:39.198665+0000","last_unstale":"2024-09-16T06:46:39.380368+0000","last_undegraded":"2024-09-16T06:46:39.380368+0000","last_fullsized":"2024-09-16T06:46:39.380368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:15.738622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574478+0000","last_change":"2024-09-16T06:46:39.189862+0000","last_active":"2024-09-16T06:46:39.574478+0000","last_peered":"2024-09-16T06:46:39.574478+0000","last_clean":"2024-09-16T06:46:39.574478+0000","last_became_active":"2024-09-16T06:46:39.189621+0000","last_became_peered":"2024-09-16T06:46:39.189621+0000","last_unstale":"2024-09-16T06:46:39.574478+0000","last_undegraded":"2024-09-16T06:46:39.574478+0000","last_fullsized":"2024-09-16T06:46:39.574478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374382+0000","last_change":"2024-09-16T06:46:39.166523+0000","last_active":"2024-09-16T06:46:39.374382+0000","last_peered":"2024-09-16T06:46:39.374382+0000","last_clean":"2024-09-16T06:46:39.374382+0000","last_became_active":"2024-09-16T06:46:39.166080+0000","last_became_peered":"2024-09-16T06:46:39.166080+0000","last_unstale":"2024-09-16T06:46:39.374382+0000","last_undegraded":"2024-09-16T06:46:39.374382+0000","last_fullsized":"2024-09-16T06:46:39.374382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572873+0000","last_change":"2024-09-16T06:46:39.192493+0000","last_active":"2024-09-16T06:46:39.572873+0000","last_peered":"2024-09-16T06:46:39.572873+0000","last_clean":"2024-09-16T06:46:39.572873+0000","last_became_active":"2024-09-16T06:46:39.191125+0000","last_became_peered":"2024-09-16T06:46:39.191125+0000","last_unstale":"2024-09-16T06:46:39.572873+0000","last_undegraded":"2024-09-16T06:46:39.572873+0000","last_fullsized":"2024-09-16T06:46:39.572873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379291+0000","last_change":"2024-09-16T06:46:39.201662+0000","last_active":"2024-09-16T06:46:39.379291+0000","last_peered":"2024-09-16T06:46:39.379291+0000","last_clean":"2024-09-16T06:46:39.379291+0000","last_became_active":"2024-09-16T06:46:39.201128+0000","last_became_peered":"2024-09-16T06:46:39.201128+0000","last_unstale":"2024-09-16T06:46:39.379291+0000","last_undegraded":"2024-09-16T06:46:39.379291+0000","last_fullsized":"2024-09-16T06:46:39.379291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373162+0000","last_change":"2024-09-16T06:46:39.165959+0000","last_active":"2024-09-16T06:46:39.373162+0000","last_peered":"2024-09-16T06:46:39.373162+0000","last_clean":"2024-09-16T06:46:39.373162+0000","last_became_active":"2024-09-16T06:46:39.165699+0000","last_became_peered":"2024-09-16T06:46:39.165699+0000","last_unstale":"2024-09-16T06:46:39.373162+0000","last_undegraded":"2024-09-16T06:46:39.373162+0000","last_fullsized":"2024-09-16T06:46:39.373162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574135+0000","last_change":"2024-09-16T06:46:39.192215+0000","last_active":"2024-09-16T06:46:39.574135+0000","last_peered":"2024-09-16T06:46:39.574135+0000","last_clean":"2024-09-16T06:46:39.574135+0000","last_became_active":"2024-09-16T06:46:39.190823+0000","last_became_peered":"2024-09-16T06:46:39.190823+0000","last_unstale":"2024-09-16T06:46:39.574135+0000","last_undegraded":"2024-09-16T06:46:39.574135+0000","last_fullsized":"2024-09-16T06:46:39.574135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574361+0000","last_change":"2024-09-16T06:46:39.191593+0000","last_active":"2024-09-16T06:46:39.574361+0000","last_peered":"2024-09-16T06:46:39.574361+0000","last_clean":"2024-09-16T06:46:39.574361+0000","last_became_active":"2024-09-16T06:46:39.191301+0000","last_became_peered":"2024-09-16T06:46:39.191301+0000","last_unstale":"2024-09-16T06:46:39.574361+0000","last_undegraded":"2024-09-16T06:46:39.574361+0000","last_fullsized":"2024-09-16T06:46:39.574361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374814+0000","last_change":"2024-09-16T06:46:39.166105+0000","last_active":"2024-09-16T06:46:39.374814+0000","last_peered":"2024-09-16T06:46:39.374814+0000","last_clean":"2024-09-16T06:46:39.374814+0000","last_became_active":"2024-09-16T06:46:39.165575+0000","last_became_peered":"2024-09-16T06:46:39.165575+0000","last_unstale":"2024-09-16T06:46:39.374814+0000","last_undegraded":"2024-09-16T06:46:39.374814+0000","last_fullsized":"2024-09-16T06:46:39.374814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575020+0000","last_change":"2024-09-16T06:46:39.191790+0000","last_active":"2024-09-16T06:46:39.575020+0000","last_peered":"2024-09-16T06:46:39.575020+0000","last_clean":"2024-09-16T06:46:39.575020+0000","last_became_active":"2024-09-16T06:46:39.191549+0000","last_became_peered":"2024-09-16T06:46:39.191549+0000","last_unstale":"2024-09-16T06:46:39.575020+0000","last_undegraded":"2024-09-16T06:46:39.575020+0000","last_fullsized":"2024-09-16T06:46:39.575020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380372+0000","last_change":"2024-09-16T06:46:39.176484+0000","last_active":"2024-09-16T06:46:39.380372+0000","last_peered":"2024-09-16T06:46:39.380372+0000","last_clean":"2024-09-16T06:46:39.380372+0000","last_became_active":"2024-09-16T06:46:39.176214+0000","last_became_peered":"2024-09-16T06:46:39.176214+0000","last_unstale":"2024-09-16T06:46:39.380372+0000","last_undegraded":"2024-09-16T06:46:39.380372+0000","last_fullsized":"2024-09-16T06:46:39.380372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573144+0000","last_change":"2024-09-16T06:46:39.188928+0000","last_active":"2024-09-16T06:46:39.573144+0000","last_peered":"2024-09-16T06:46:39.573144+0000","last_clean":"2024-09-16T06:46:39.573144+0000","last_became_active":"2024-09-16T06:46:39.188620+0000","last_became_peered":"2024-09-16T06:46:39.188620+0000","last_unstale":"2024-09-16T06:46:39.573144+0000","last_undegraded":"2024-09-16T06:46:39.573144+0000","last_fullsized":"2024-09-16T06:46:39.573144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379459+0000","last_change":"2024-09-16T06:46:39.200952+0000","last_active":"2024-09-16T06:46:39.379459+0000","last_peered":"2024-09-16T06:46:39.379459+0000","last_clean":"2024-09-16T06:46:39.379459+0000","last_became_active":"2024-09-16T06:46:39.197413+0000","last_became_peered":"2024-09-16T06:46:39.197413+0000","last_unstale":"2024-09-16T06:46:39.379459+0000","last_undegraded":"2024-09-16T06:46:39.379459+0000","last_fullsized":"2024-09-16T06:46:39.379459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373219+0000","last_change":"2024-09-16T06:46:39.183560+0000","last_active":"2024-09-16T06:46:39.373219+0000","last_peered":"2024-09-16T06:46:39.373219+0000","last_clean":"2024-09-16T06:46:39.373219+0000","last_became_active":"2024-09-16T06:46:39.182899+0000","last_became_peered":"2024-09-16T06:46:39.182899+0000","last_unstale":"2024-09-16T06:46:39.373219+0000","last_undegraded":"2024-09-16T06:46:39.373219+0000","last_fullsized":"2024-09-16T06:46:39.373219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381984+0000","last_change":"2024-09-16T06:46:39.200486+0000","last_active":"2024-09-16T06:46:39.381984+0000","last_peered":"2024-09-16T06:46:39.381984+0000","last_clean":"2024-09-16T06:46:39.381984+0000","last_became_active":"2024-09-16T06:46:39.198054+0000","last_became_peered":"2024-09-16T06:46:39.198054+0000","last_unstale":"2024-09-16T06:46:39.381984+0000","last_undegraded":"2024-09-16T06:46:39.381984+0000","last_fullsized":"2024-09-16T06:46:39.381984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381262+0000","last_change":"2024-09-16T06:46:38.819482+0000","last_active":"2024-09-16T06:46:39.381262+0000","last_peered":"2024-09-16T06:46:39.381262+0000","last_clean":"2024-09-16T06:46:39.381262+0000","last_became_active":"2024-09-16T06:46:38.818284+0000","last_became_peered":"2024-09-16T06:46:38.818284+0000","last_unstale":"2024-09-16T06:46:39.381262+0000","last_undegraded":"2024-09-16T06:46:39.381262+0000","last_fullsized":"2024-09-16T06:46:39.381262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:20.195598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382318+0000","last_change":"2024-09-16T06:46:39.195870+0000","last_active":"2024-09-16T06:46:39.382318+0000","last_peered":"2024-09-16T06:46:39.382318+0000","last_clean":"2024-09-16T06:46:39.382318+0000","last_became_active":"2024-09-16T06:46:39.194071+0000","last_became_peered":"2024-09-16T06:46:39.194071+0000","last_unstale":"2024-09-16T06:46:39.382318+0000","last_undegraded":"2024-09-16T06:46:39.382318+0000","last_fullsized":"2024-09-16T06:46:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:53.619215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380249+0000","last_change":"2024-09-16T06:46:38.827083+0000","last_active":"2024-09-16T06:46:39.380249+0000","last_peered":"2024-09-16T06:46:39.380249+0000","last_clean":"2024-09-16T06:46:39.380249+0000","last_became_active":"2024-09-16T06:46:38.826329+0000","last_became_peered":"2024-09-16T06:46:38.826329+0000","last_unstale":"2024-09-16T06:46:39.380249+0000","last_undegraded":"2024-09-16T06:46:39.380249+0000","last_fullsized":"2024-09-16T06:46:39.380249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:23.891217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382370+0000","last_change":"2024-09-16T06:46:39.200568+0000","last_active":"2024-09-16T06:46:39.382370+0000","last_peered":"2024-09-16T06:46:39.382370+0000","last_clean":"2024-09-16T06:46:39.382370+0000","last_became_active":"2024-09-16T06:46:39.197902+0000","last_became_peered":"2024-09-16T06:46:39.197902+0000","last_unstale":"2024-09-16T06:46:39.382370+0000","last_undegraded":"2024-09-16T06:46:39.382370+0000","last_fullsized":"2024-09-16T06:46:39.382370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373400+0000","last_change":"2024-09-16T06:46:38.831919+0000","last_active":"2024-09-16T06:46:39.373400+0000","last_peered":"2024-09-16T06:46:39.373400+0000","last_clean":"2024-09-16T06:46:39.373400+0000","last_became_active":"2024-09-16T06:46:38.831609+0000","last_became_peered":"2024-09-16T06:46:38.831609+0000","last_unstale":"2024-09-16T06:46:39.373400+0000","last_undegraded":"2024-09-16T06:46:39.373400+0000","last_fullsized":"2024-09-16T06:46:39.373400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382988+0000","last_change":"2024-09-16T06:46:39.200573+0000","last_active":"2024-09-16T06:46:39.382988+0000","last_peered":"2024-09-16T06:46:39.382988+0000","last_clean":"2024-09-16T06:46:39.382988+0000","last_became_active":"2024-09-16T06:46:39.198472+0000","last_became_peered":"2024-09-16T06:46:39.198472+0000","last_unstale":"2024-09-16T06:46:39.382988+0000","last_undegraded":"2024-09-16T06:46:39.382988+0000","last_fullsized":"2024-09-16T06:46:39.382988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373251+0000","last_change":"2024-09-16T06:46:38.827569+0000","last_active":"2024-09-16T06:46:39.373251+0000","last_peered":"2024-09-16T06:46:39.373251+0000","last_clean":"2024-09-16T06:46:39.373251+0000","last_became_active":"2024-09-16T06:46:38.827207+0000","last_became_peered":"2024-09-16T06:46:38.827207+0000","last_unstale":"2024-09-16T06:46:39.373251+0000","last_undegraded":"2024-09-16T06:46:39.373251+0000","last_fullsized":"2024-09-16T06:46:39.373251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:03.087447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374993+0000","last_change":"2024-09-16T06:46:38.838219+0000","last_active":"2024-09-16T06:46:39.374993+0000","last_peered":"2024-09-16T06:46:39.374993+0000","last_clean":"2024-09-16T06:46:39.374993+0000","last_became_active":"2024-09-16T06:46:38.837847+0000","last_became_peered":"2024-09-16T06:46:38.837847+0000","last_unstale":"2024-09-16T06:46:39.374993+0000","last_undegraded":"2024-09-16T06:46:39.374993+0000","last_fullsized":"2024-09-16T06:46:39.374993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:29.278281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379022+0000","last_change":"2024-09-16T06:46:39.178965+0000","last_active":"2024-09-16T06:46:39.379022+0000","last_peered":"2024-09-16T06:46:39.379022+0000","last_clean":"2024-09-16T06:46:39.379022+0000","last_became_active":"2024-09-16T06:46:39.178626+0000","last_became_peered":"2024-09-16T06:46:39.178626+0000","last_unstale":"2024-09-16T06:46:39.379022+0000","last_undegraded":"2024-09-16T06:46:39.379022+0000","last_fullsized":"2024-09-16T06:46:39.379022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:07.184854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374813+0000","last_change":"2024-09-16T06:46:38.810716+0000","last_active":"2024-09-16T06:46:39.374813+0000","last_peered":"2024-09-16T06:46:39.374813+0000","last_clean":"2024-09-16T06:46:39.374813+0000","last_became_active":"2024-09-16T06:46:38.810300+0000","last_became_peered":"2024-09-16T06:46:38.810300+0000","last_unstale":"2024-09-16T06:46:39.374813+0000","last_undegraded":"2024-09-16T06:46:39.374813+0000","last_fullsized":"2024-09-16T06:46:39.374813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:45.971482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573028+0000","last_change":"2024-09-16T06:46:39.200612+0000","last_active":"2024-09-16T06:46:39.573028+0000","last_peered":"2024-09-16T06:46:39.573028+0000","last_clean":"2024-09-16T06:46:39.573028+0000","last_became_active":"2024-09-16T06:46:39.200182+0000","last_became_peered":"2024-09-16T06:46:39.200182+0000","last_unstale":"2024-09-16T06:46:39.573028+0000","last_undegraded":"2024-09-16T06:46:39.573028+0000","last_fullsized":"2024-09-16T06:46:39.573028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374666+0000","last_change":"2024-09-16T06:46:38.828295+0000","last_active":"2024-09-16T06:46:39.374666+0000","last_peered":"2024-09-16T06:46:39.374666+0000","last_clean":"2024-09-16T06:46:39.374666+0000","last_became_active":"2024-09-16T06:46:38.827978+0000","last_became_peered":"2024-09-16T06:46:38.827978+0000","last_unstale":"2024-09-16T06:46:39.374666+0000","last_undegraded":"2024-09-16T06:46:39.374666+0000","last_fullsized":"2024-09-16T06:46:39.374666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:41.144933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373659+0000","last_change":"2024-09-16T06:46:39.165852+0000","last_active":"2024-09-16T06:46:39.373659+0000","last_peered":"2024-09-16T06:46:39.373659+0000","last_clean":"2024-09-16T06:46:39.373659+0000","last_became_active":"2024-09-16T06:46:39.165606+0000","last_became_peered":"2024-09-16T06:46:39.165606+0000","last_unstale":"2024-09-16T06:46:39.373659+0000","last_undegraded":"2024-09-16T06:46:39.373659+0000","last_fullsized":"2024-09-16T06:46:39.373659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374787+0000","last_change":"2024-09-16T06:46:38.791462+0000","last_active":"2024-09-16T06:46:39.374787+0000","last_peered":"2024-09-16T06:46:39.374787+0000","last_clean":"2024-09-16T06:46:39.374787+0000","last_became_active":"2024-09-16T06:46:38.790888+0000","last_became_peered":"2024-09-16T06:46:38.790888+0000","last_unstale":"2024-09-16T06:46:39.374787+0000","last_undegraded":"2024-09-16T06:46:39.374787+0000","last_fullsized":"2024-09-16T06:46:39.374787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380151+0000","last_change":"2024-09-16T06:46:39.194753+0000","last_active":"2024-09-16T06:46:39.380151+0000","last_peered":"2024-09-16T06:46:39.380151+0000","last_clean":"2024-09-16T06:46:39.380151+0000","last_became_active":"2024-09-16T06:46:39.194441+0000","last_became_peered":"2024-09-16T06:46:39.194441+0000","last_unstale":"2024-09-16T06:46:39.380151+0000","last_undegraded":"2024-09-16T06:46:39.380151+0000","last_fullsized":"2024-09-16T06:46:39.380151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:10.938486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381628+0000","last_change":"2024-09-16T06:46:38.828919+0000","last_active":"2024-09-16T06:46:39.381628+0000","last_peered":"2024-09-16T06:46:39.381628+0000","last_clean":"2024-09-16T06:46:39.381628+0000","last_became_active":"2024-09-16T06:46:38.827632+0000","last_became_peered":"2024-09-16T06:46:38.827632+0000","last_unstale":"2024-09-16T06:46:39.381628+0000","last_undegraded":"2024-09-16T06:46:39.381628+0000","last_fullsized":"2024-09-16T06:46:39.381628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574796+0000","last_change":"2024-09-16T06:46:39.199721+0000","last_active":"2024-09-16T06:46:39.574796+0000","last_peered":"2024-09-16T06:46:39.574796+0000","last_clean":"2024-09-16T06:46:39.574796+0000","last_became_active":"2024-09-16T06:46:39.198781+0000","last_became_peered":"2024-09-16T06:46:39.198781+0000","last_unstale":"2024-09-16T06:46:39.574796+0000","last_undegraded":"2024-09-16T06:46:39.574796+0000","last_fullsized":"2024-09-16T06:46:39.574796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373852+0000","last_change":"2024-09-16T06:46:38.827548+0000","last_active":"2024-09-16T06:46:39.373852+0000","last_peered":"2024-09-16T06:46:39.373852+0000","last_clean":"2024-09-16T06:46:39.373852+0000","last_became_active":"2024-09-16T06:46:38.827223+0000","last_became_peered":"2024-09-16T06:46:38.827223+0000","last_unstale":"2024-09-16T06:46:39.373852+0000","last_undegraded":"2024-09-16T06:46:39.373852+0000","last_fullsized":"2024-09-16T06:46:39.373852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:24.775378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374413+0000","last_change":"2024-09-16T06:46:39.182960+0000","last_active":"2024-09-16T06:46:39.374413+0000","last_peered":"2024-09-16T06:46:39.374413+0000","last_clean":"2024-09-16T06:46:39.374413+0000","last_became_active":"2024-09-16T06:46:39.182729+0000","last_became_peered":"2024-09-16T06:46:39.182729+0000","last_unstale":"2024-09-16T06:46:39.374413+0000","last_undegraded":"2024-09-16T06:46:39.374413+0000","last_fullsized":"2024-09-16T06:46:39.374413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379585+0000","last_change":"2024-09-16T06:46:38.828147+0000","last_active":"2024-09-16T06:46:39.379585+0000","last_peered":"2024-09-16T06:46:39.379585+0000","last_clean":"2024-09-16T06:46:39.379585+0000","last_became_active":"2024-09-16T06:46:38.810187+0000","last_became_peered":"2024-09-16T06:46:38.810187+0000","last_unstale":"2024-09-16T06:46:39.379585+0000","last_undegraded":"2024-09-16T06:46:39.379585+0000","last_fullsized":"2024-09-16T06:46:39.379585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:49.449347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380665+0000","last_change":"2024-09-16T06:46:39.188782+0000","last_active":"2024-09-16T06:46:39.380665+0000","last_peered":"2024-09-16T06:46:39.380665+0000","last_clean":"2024-09-16T06:46:39.380665+0000","last_became_active":"2024-09-16T06:46:39.188111+0000","last_became_peered":"2024-09-16T06:46:39.188111+0000","last_unstale":"2024-09-16T06:46:39.380665+0000","last_undegraded":"2024-09-16T06:46:39.380665+0000","last_fullsized":"2024-09-16T06:46:39.380665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:42.155860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379176+0000","last_change":"2024-09-16T06:46:38.843585+0000","last_active":"2024-09-16T06:46:39.379176+0000","last_peered":"2024-09-16T06:46:39.379176+0000","last_clean":"2024-09-16T06:46:39.379176+0000","last_became_active":"2024-09-16T06:46:38.842948+0000","last_became_peered":"2024-09-16T06:46:38.842948+0000","last_unstale":"2024-09-16T06:46:39.379176+0000","last_undegraded":"2024-09-16T06:46:39.379176+0000","last_fullsized":"2024-09-16T06:46:39.379176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:35.981497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574259+0000","last_change":"2024-09-16T06:46:39.205252+0000","last_active":"2024-09-16T06:46:39.574259+0000","last_peered":"2024-09-16T06:46:39.574259+0000","last_clean":"2024-09-16T06:46:39.574259+0000","last_became_active":"2024-09-16T06:46:39.204938+0000","last_became_peered":"2024-09-16T06:46:39.204938+0000","last_unstale":"2024-09-16T06:46:39.574259+0000","last_undegraded":"2024-09-16T06:46:39.574259+0000","last_fullsized":"2024-09-16T06:46:39.574259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.172541+0000","last_change":"2024-09-16T06:46:28.420745+0000","last_active":"2024-09-16T06:46:39.172541+0000","last_peered":"2024-09-16T06:46:39.172541+0000","last_clean":"2024-09-16T06:46:39.172541+0000","last_became_active":"2024-09-16T06:46:28.419090+0000","last_became_peered":"2024-09-16T06:46:28.419090+0000","last_unstale":"2024-09-16T06:46:39.172541+0000","last_undegraded":"2024-09-16T06:46:39.172541+0000","last_fullsized":"2024-09-16T06:46:39.172541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_clean_scrub_stamp":"2024-09-16T06:46:27.264921+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:28:51.531389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374566+0000","last_change":"2024-09-16T06:46:34.591498+0000","last_active":"2024-09-16T06:46:39.374566+0000","last_peered":"2024-09-16T06:46:39.374566+0000","last_clean":"2024-09-16T06:46:39.374566+0000","last_became_active":"2024-09-16T06:46:32.591383+0000","last_became_peered":"2024-09-16T06:46:32.591383+0000","last_unstale":"2024-09-16T06:46:39.374566+0000","last_undegraded":"2024-09-16T06:46:39.374566+0000","last_fullsized":"2024-09-16T06:46:39.374566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:53.253566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010025520000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380170+0000","last_change":"2024-09-16T06:46:38.820440+0000","last_active":"2024-09-16T06:46:39.380170+0000","last_peered":"2024-09-16T06:46:39.380170+0000","last_clean":"2024-09-16T06:46:39.380170+0000","last_became_active":"2024-09-16T06:46:38.818437+0000","last_became_peered":"2024-09-16T06:46:38.818437+0000","last_unstale":"2024-09-16T06:46:39.380170+0000","last_undegraded":"2024-09-16T06:46:39.380170+0000","last_fullsized":"2024-09-16T06:46:39.380170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:04.350191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374591+0000","last_change":"2024-09-16T06:46:39.182247+0000","last_active":"2024-09-16T06:46:39.374591+0000","last_peered":"2024-09-16T06:46:39.374591+0000","last_clean":"2024-09-16T06:46:39.374591+0000","last_became_active":"2024-09-16T06:46:39.181061+0000","last_became_peered":"2024-09-16T06:46:39.181061+0000","last_unstale":"2024-09-16T06:46:39.374591+0000","last_undegraded":"2024-09-16T06:46:39.374591+0000","last_fullsized":"2024-09-16T06:46:39.374591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:11.090727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373360+0000","last_change":"2024-09-16T06:46:34.591483+0000","last_active":"2024-09-16T06:46:39.373360+0000","last_peered":"2024-09-16T06:46:39.373360+0000","last_clean":"2024-09-16T06:46:39.373360+0000","last_became_active":"2024-09-16T06:46:32.587817+0000","last_became_peered":"2024-09-16T06:46:32.587817+0000","last_unstale":"2024-09-16T06:46:39.373360+0000","last_undegraded":"2024-09-16T06:46:39.373360+0000","last_fullsized":"2024-09-16T06:46:39.373360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010582059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573485+0000","last_change":"2024-09-16T06:46:38.837265+0000","last_active":"2024-09-16T06:46:39.573485+0000","last_peered":"2024-09-16T06:46:39.573485+0000","last_clean":"2024-09-16T06:46:39.573485+0000","last_became_active":"2024-09-16T06:46:38.832115+0000","last_became_peered":"2024-09-16T06:46:38.832115+0000","last_unstale":"2024-09-16T06:46:39.573485+0000","last_undegraded":"2024-09-16T06:46:39.573485+0000","last_fullsized":"2024-09-16T06:46:39.573485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:06.148145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382717+0000","last_change":"2024-09-16T06:46:39.200924+0000","last_active":"2024-09-16T06:46:39.382717+0000","last_peered":"2024-09-16T06:46:39.382717+0000","last_clean":"2024-09-16T06:46:39.382717+0000","last_became_active":"2024-09-16T06:46:39.200607+0000","last_became_peered":"2024-09-16T06:46:39.200607+0000","last_unstale":"2024-09-16T06:46:39.382717+0000","last_undegraded":"2024-09-16T06:46:39.382717+0000","last_fullsized":"2024-09-16T06:46:39.382717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379692+0000","last_change":"2024-09-16T06:46:34.715640+0000","last_active":"2024-09-16T06:46:39.379692+0000","last_peered":"2024-09-16T06:46:39.379692+0000","last_clean":"2024-09-16T06:46:39.379692+0000","last_became_active":"2024-09-16T06:46:32.593992+0000","last_became_peered":"2024-09-16T06:46:32.593992+0000","last_unstale":"2024-09-16T06:46:39.379692+0000","last_undegraded":"2024-09-16T06:46:39.379692+0000","last_fullsized":"2024-09-16T06:46:39.379692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:30.696024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051250899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572853+0000","last_change":"2024-09-16T06:46:38.831231+0000","last_active":"2024-09-16T06:46:39.572853+0000","last_peered":"2024-09-16T06:46:39.572853+0000","last_clean":"2024-09-16T06:46:39.572853+0000","last_became_active":"2024-09-16T06:46:38.830405+0000","last_became_peered":"2024-09-16T06:46:38.830405+0000","last_unstale":"2024-09-16T06:46:39.572853+0000","last_undegraded":"2024-09-16T06:46:39.572853+0000","last_fullsized":"2024-09-16T06:46:39.572853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574391+0000","last_change":"2024-09-16T06:46:39.199732+0000","last_active":"2024-09-16T06:46:39.574391+0000","last_peered":"2024-09-16T06:46:39.574391+0000","last_clean":"2024-09-16T06:46:39.574391+0000","last_became_active":"2024-09-16T06:46:39.199407+0000","last_became_peered":"2024-09-16T06:46:39.199407+0000","last_unstale":"2024-09-16T06:46:39.574391+0000","last_undegraded":"2024-09-16T06:46:39.574391+0000","last_fullsized":"2024-09-16T06:46:39.574391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373924+0000","last_change":"2024-09-16T06:46:34.592232+0000","last_active":"2024-09-16T06:46:39.373924+0000","last_peered":"2024-09-16T06:46:39.373924+0000","last_clean":"2024-09-16T06:46:39.373924+0000","last_became_active":"2024-09-16T06:46:32.584409+0000","last_became_peered":"2024-09-16T06:46:32.584409+0000","last_unstale":"2024-09-16T06:46:39.373924+0000","last_undegraded":"2024-09-16T06:46:39.373924+0000","last_fullsized":"2024-09-16T06:46:39.373924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001754603,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374471+0000","last_change":"2024-09-16T06:46:38.815767+0000","last_active":"2024-09-16T06:46:39.374471+0000","last_peered":"2024-09-16T06:46:39.374471+0000","last_clean":"2024-09-16T06:46:39.374471+0000","last_became_active":"2024-09-16T06:46:38.815553+0000","last_became_peered":"2024-09-16T06:46:38.815553+0000","last_unstale":"2024-09-16T06:46:39.374471+0000","last_undegraded":"2024-09-16T06:46:39.374471+0000","last_fullsized":"2024-09-16T06:46:39.374471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:03.610912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574733+0000","last_change":"2024-09-16T06:46:39.194564+0000","last_active":"2024-09-16T06:46:39.574733+0000","last_peered":"2024-09-16T06:46:39.574733+0000","last_clean":"2024-09-16T06:46:39.574733+0000","last_became_active":"2024-09-16T06:46:39.194168+0000","last_became_peered":"2024-09-16T06:46:39.194168+0000","last_unstale":"2024-09-16T06:46:39.574733+0000","last_undegraded":"2024-09-16T06:46:39.574733+0000","last_fullsized":"2024-09-16T06:46:39.574733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374696+0000","last_change":"2024-09-16T06:46:38.828799+0000","last_active":"2024-09-16T06:46:39.374696+0000","last_peered":"2024-09-16T06:46:39.374696+0000","last_clean":"2024-09-16T06:46:39.374696+0000","last_became_active":"2024-09-16T06:46:38.828136+0000","last_became_peered":"2024-09-16T06:46:38.828136+0000","last_unstale":"2024-09-16T06:46:39.374696+0000","last_undegraded":"2024-09-16T06:46:39.374696+0000","last_fullsized":"2024-09-16T06:46:39.374696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:33.286790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575150+0000","last_change":"2024-09-16T06:46:34.595510+0000","last_active":"2024-09-16T06:46:39.575150+0000","last_peered":"2024-09-16T06:46:39.575150+0000","last_clean":"2024-09-16T06:46:39.575150+0000","last_became_active":"2024-09-16T06:46:32.588966+0000","last_became_peered":"2024-09-16T06:46:32.588966+0000","last_unstale":"2024-09-16T06:46:39.575150+0000","last_undegraded":"2024-09-16T06:46:39.575150+0000","last_fullsized":"2024-09-16T06:46:39.575150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082793000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572993+0000","last_change":"2024-09-16T06:46:39.192738+0000","last_active":"2024-09-16T06:46:39.572993+0000","last_peered":"2024-09-16T06:46:39.572993+0000","last_clean":"2024-09-16T06:46:39.572993+0000","last_became_active":"2024-09-16T06:46:39.192227+0000","last_became_peered":"2024-09-16T06:46:39.192227+0000","last_unstale":"2024-09-16T06:46:39.572993+0000","last_undegraded":"2024-09-16T06:46:39.572993+0000","last_fullsized":"2024-09-16T06:46:39.572993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575058+0000","last_change":"2024-09-16T06:46:38.836459+0000","last_active":"2024-09-16T06:46:39.575058+0000","last_peered":"2024-09-16T06:46:39.575058+0000","last_clean":"2024-09-16T06:46:39.575058+0000","last_became_active":"2024-09-16T06:46:38.832248+0000","last_became_peered":"2024-09-16T06:46:38.832248+0000","last_unstale":"2024-09-16T06:46:39.575058+0000","last_undegraded":"2024-09-16T06:46:39.575058+0000","last_fullsized":"2024-09-16T06:46:39.575058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:56.866622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374900+0000","last_change":"2024-09-16T06:46:34.592592+0000","last_active":"2024-09-16T06:46:39.374900+0000","last_peered":"2024-09-16T06:46:39.374900+0000","last_clean":"2024-09-16T06:46:39.374900+0000","last_became_active":"2024-09-16T06:46:32.591488+0000","last_became_peered":"2024-09-16T06:46:32.591488+0000","last_unstale":"2024-09-16T06:46:39.374900+0000","last_undegraded":"2024-09-16T06:46:39.374900+0000","last_fullsized":"2024-09-16T06:46:39.374900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:46:25.248987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018038799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573210+0000","last_change":"2024-09-16T06:46:39.193260+0000","last_active":"2024-09-16T06:46:39.573210+0000","last_peered":"2024-09-16T06:46:39.573210+0000","last_clean":"2024-09-16T06:46:39.573210+0000","last_became_active":"2024-09-16T06:46:39.192979+0000","last_became_peered":"2024-09-16T06:46:39.192979+0000","last_unstale":"2024-09-16T06:46:39.573210+0000","last_undegraded":"2024-09-16T06:46:39.573210+0000","last_fullsized":"2024-09-16T06:46:39.573210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.383066+0000","last_change":"2024-09-16T06:46:38.843068+0000","last_active":"2024-09-16T06:46:39.383066+0000","last_peered":"2024-09-16T06:46:39.383066+0000","last_clean":"2024-09-16T06:46:39.383066+0000","last_became_active":"2024-09-16T06:46:38.842540+0000","last_became_peered":"2024-09-16T06:46:38.842540+0000","last_unstale":"2024-09-16T06:46:39.383066+0000","last_undegraded":"2024-09-16T06:46:39.383066+0000","last_fullsized":"2024-09-16T06:46:39.383066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574707+0000","last_change":"2024-09-16T06:46:34.595534+0000","last_active":"2024-09-16T06:46:39.574707+0000","last_peered":"2024-09-16T06:46:39.574707+0000","last_clean":"2024-09-16T06:46:39.574707+0000","last_became_active":"2024-09-16T06:46:32.591633+0000","last_became_peered":"2024-09-16T06:46:32.591633+0000","last_unstale":"2024-09-16T06:46:39.574707+0000","last_undegraded":"2024-09-16T06:46:39.574707+0000","last_fullsized":"2024-09-16T06:46:39.574707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084554300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379049+0000","last_change":"2024-09-16T06:46:39.198185+0000","last_active":"2024-09-16T06:46:39.379049+0000","last_peered":"2024-09-16T06:46:39.379049+0000","last_clean":"2024-09-16T06:46:39.379049+0000","last_became_active":"2024-09-16T06:46:39.197829+0000","last_became_peered":"2024-09-16T06:46:39.197829+0000","last_unstale":"2024-09-16T06:46:39.379049+0000","last_undegraded":"2024-09-16T06:46:39.379049+0000","last_fullsized":"2024-09-16T06:46:39.379049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.768079+0000","last_change":"2024-09-16T06:46:38.824771+0000","last_active":"2024-09-16T06:46:39.768079+0000","last_peered":"2024-09-16T06:46:39.768079+0000","last_clean":"2024-09-16T06:46:39.768079+0000","last_became_active":"2024-09-16T06:46:38.824096+0000","last_became_peered":"2024-09-16T06:46:38.824096+0000","last_unstale":"2024-09-16T06:46:39.768079+0000","last_undegraded":"2024-09-16T06:46:39.768079+0000","last_fullsized":"2024-09-16T06:46:39.768079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.375046+0000","last_change":"2024-09-16T06:46:34.592095+0000","last_active":"2024-09-16T06:46:39.375046+0000","last_peered":"2024-09-16T06:46:39.375046+0000","last_clean":"2024-09-16T06:46:39.375046+0000","last_became_active":"2024-09-16T06:46:32.585129+0000","last_became_peered":"2024-09-16T06:46:32.585129+0000","last_unstale":"2024-09-16T06:46:39.375046+0000","last_undegraded":"2024-09-16T06:46:39.375046+0000","last_fullsized":"2024-09-16T06:46:39.375046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:55.521712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015900179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379347+0000","last_change":"2024-09-16T06:46:39.187196+0000","last_active":"2024-09-16T06:46:39.379347+0000","last_peered":"2024-09-16T06:46:39.379347+0000","last_clean":"2024-09-16T06:46:39.379347+0000","last_became_active":"2024-09-16T06:46:39.184981+0000","last_became_peered":"2024-09-16T06:46:39.184981+0000","last_unstale":"2024-09-16T06:46:39.379347+0000","last_undegraded":"2024-09-16T06:46:39.379347+0000","last_fullsized":"2024-09-16T06:46:39.379347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:34.297717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379916+0000","last_change":"2024-09-16T06:46:39.185361+0000","last_active":"2024-09-16T06:46:39.379916+0000","last_peered":"2024-09-16T06:46:39.379916+0000","last_clean":"2024-09-16T06:46:39.379916+0000","last_became_active":"2024-09-16T06:46:39.185017+0000","last_became_peered":"2024-09-16T06:46:39.185017+0000","last_unstale":"2024-09-16T06:46:39.379916+0000","last_undegraded":"2024-09-16T06:46:39.379916+0000","last_fullsized":"2024-09-16T06:46:39.379916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:57.877549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374658+0000","last_change":"2024-09-16T06:46:38.804787+0000","last_active":"2024-09-16T06:46:39.374658+0000","last_peered":"2024-09-16T06:46:39.374658+0000","last_clean":"2024-09-16T06:46:39.374658+0000","last_became_active":"2024-09-16T06:46:38.804503+0000","last_became_peered":"2024-09-16T06:46:38.804503+0000","last_unstale":"2024-09-16T06:46:39.374658+0000","last_undegraded":"2024-09-16T06:46:39.374658+0000","last_fullsized":"2024-09-16T06:46:39.374658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:58.375210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573446+0000","last_change":"2024-09-16T06:46:39.185466+0000","last_active":"2024-09-16T06:46:39.573446+0000","last_peered":"2024-09-16T06:46:39.573446+0000","last_clean":"2024-09-16T06:46:39.573446+0000","last_became_active":"2024-09-16T06:46:39.185188+0000","last_became_peered":"2024-09-16T06:46:39.185188+0000","last_unstale":"2024-09-16T06:46:39.573446+0000","last_undegraded":"2024-09-16T06:46:39.573446+0000","last_fullsized":"2024-09-16T06:46:39.573446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381315+0000","last_change":"2024-09-16T06:46:38.826430+0000","last_active":"2024-09-16T06:46:39.381315+0000","last_peered":"2024-09-16T06:46:39.381315+0000","last_clean":"2024-09-16T06:46:39.381315+0000","last_became_active":"2024-09-16T06:46:38.825763+0000","last_became_peered":"2024-09-16T06:46:38.825763+0000","last_unstale":"2024-09-16T06:46:39.381315+0000","last_undegraded":"2024-09-16T06:46:39.381315+0000","last_fullsized":"2024-09-16T06:46:39.381315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:55.060544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374601+0000","last_change":"2024-09-16T06:46:38.828786+0000","last_active":"2024-09-16T06:46:39.374601+0000","last_peered":"2024-09-16T06:46:39.374601+0000","last_clean":"2024-09-16T06:46:39.374601+0000","last_became_active":"2024-09-16T06:46:38.827157+0000","last_became_peered":"2024-09-16T06:46:38.827157+0000","last_unstale":"2024-09-16T06:46:39.374601+0000","last_undegraded":"2024-09-16T06:46:39.374601+0000","last_fullsized":"2024-09-16T06:46:39.374601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:10:03.077384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379573+0000","last_change":"2024-09-16T06:46:39.195693+0000","last_active":"2024-09-16T06:46:39.379573+0000","last_peered":"2024-09-16T06:46:39.379573+0000","last_clean":"2024-09-16T06:46:39.379573+0000","last_became_active":"2024-09-16T06:46:39.180517+0000","last_became_peered":"2024-09-16T06:46:39.180517+0000","last_unstale":"2024-09-16T06:46:39.379573+0000","last_undegraded":"2024-09-16T06:46:39.379573+0000","last_fullsized":"2024-09-16T06:46:39.379573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:16.222534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574953+0000","last_change":"2024-09-16T06:46:38.842337+0000","last_active":"2024-09-16T06:46:39.574953+0000","last_peered":"2024-09-16T06:46:39.574953+0000","last_clean":"2024-09-16T06:46:39.574953+0000","last_became_active":"2024-09-16T06:46:38.841847+0000","last_became_peered":"2024-09-16T06:46:38.841847+0000","last_unstale":"2024-09-16T06:46:39.574953+0000","last_undegraded":"2024-09-16T06:46:39.574953+0000","last_fullsized":"2024-09-16T06:46:39.574953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.378908+0000","last_change":"2024-09-16T06:46:39.186930+0000","last_active":"2024-09-16T06:46:39.378908+0000","last_peered":"2024-09-16T06:46:39.378908+0000","last_clean":"2024-09-16T06:46:39.378908+0000","last_became_active":"2024-09-16T06:46:39.179564+0000","last_became_peered":"2024-09-16T06:46:39.179564+0000","last_unstale":"2024-09-16T06:46:39.378908+0000","last_undegraded":"2024-09-16T06:46:39.378908+0000","last_fullsized":"2024-09-16T06:46:39.378908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374942+0000","last_change":"2024-09-16T06:46:39.175212+0000","last_active":"2024-09-16T06:46:39.374942+0000","last_peered":"2024-09-16T06:46:39.374942+0000","last_clean":"2024-09-16T06:46:39.374942+0000","last_became_active":"2024-09-16T06:46:39.175010+0000","last_became_peered":"2024-09-16T06:46:39.175010+0000","last_unstale":"2024-09-16T06:46:39.374942+0000","last_undegraded":"2024-09-16T06:46:39.374942+0000","last_fullsized":"2024-09-16T06:46:39.374942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379170+0000","last_change":"2024-09-16T06:46:38.833982+0000","last_active":"2024-09-16T06:46:39.379170+0000","last_peered":"2024-09-16T06:46:39.379170+0000","last_clean":"2024-09-16T06:46:39.379170+0000","last_became_active":"2024-09-16T06:46:38.833337+0000","last_became_peered":"2024-09-16T06:46:38.833337+0000","last_unstale":"2024-09-16T06:46:39.379170+0000","last_undegraded":"2024-09-16T06:46:39.379170+0000","last_fullsized":"2024-09-16T06:46:39.379170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574266+0000","last_change":"2024-09-16T06:46:39.192612+0000","last_active":"2024-09-16T06:46:39.574266+0000","last_peered":"2024-09-16T06:46:39.574266+0000","last_clean":"2024-09-16T06:46:39.574266+0000","last_became_active":"2024-09-16T06:46:39.192292+0000","last_became_peered":"2024-09-16T06:46:39.192292+0000","last_unstale":"2024-09-16T06:46:39.574266+0000","last_undegraded":"2024-09-16T06:46:39.574266+0000","last_fullsized":"2024-09-16T06:46:39.574266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573272+0000","last_change":"2024-09-16T06:46:38.845796+0000","last_active":"2024-09-16T06:46:39.573272+0000","last_peered":"2024-09-16T06:46:39.573272+0000","last_clean":"2024-09-16T06:46:39.573272+0000","last_became_active":"2024-09-16T06:46:38.845067+0000","last_became_peered":"2024-09-16T06:46:38.845067+0000","last_unstale":"2024-09-16T06:46:39.573272+0000","last_undegraded":"2024-09-16T06:46:39.573272+0000","last_fullsized":"2024-09-16T06:46:39.573272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:46.841092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382233+0000","last_change":"2024-09-16T06:46:39.197876+0000","last_active":"2024-09-16T06:46:39.382233+0000","last_peered":"2024-09-16T06:46:39.382233+0000","last_clean":"2024-09-16T06:46:39.382233+0000","last_became_active":"2024-09-16T06:46:39.197577+0000","last_became_peered":"2024-09-16T06:46:39.197577+0000","last_unstale":"2024-09-16T06:46:39.382233+0000","last_undegraded":"2024-09-16T06:46:39.382233+0000","last_fullsized":"2024-09-16T06:46:39.382233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:38.035227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373743+0000","last_change":"2024-09-16T06:46:38.828782+0000","last_active":"2024-09-16T06:46:39.373743+0000","last_peered":"2024-09-16T06:46:39.373743+0000","last_clean":"2024-09-16T06:46:39.373743+0000","last_became_active":"2024-09-16T06:46:38.827397+0000","last_became_peered":"2024-09-16T06:46:38.827397+0000","last_unstale":"2024-09-16T06:46:39.373743+0000","last_undegraded":"2024-09-16T06:46:39.373743+0000","last_fullsized":"2024-09-16T06:46:39.373743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:13.559277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380975+0000","last_change":"2024-09-16T06:46:39.197981+0000","last_active":"2024-09-16T06:46:39.380975+0000","last_peered":"2024-09-16T06:46:39.380975+0000","last_clean":"2024-09-16T06:46:39.380975+0000","last_became_active":"2024-09-16T06:46:39.197563+0000","last_became_peered":"2024-09-16T06:46:39.197563+0000","last_unstale":"2024-09-16T06:46:39.380975+0000","last_undegraded":"2024-09-16T06:46:39.380975+0000","last_fullsized":"2024-09-16T06:46:39.380975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:04.098374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380879+0000","last_change":"2024-09-16T06:46:38.820441+0000","last_active":"2024-09-16T06:46:39.380879+0000","last_peered":"2024-09-16T06:46:39.380879+0000","last_clean":"2024-09-16T06:46:39.380879+0000","last_became_active":"2024-09-16T06:46:38.819557+0000","last_became_peered":"2024-09-16T06:46:38.819557+0000","last_unstale":"2024-09-16T06:46:39.380879+0000","last_undegraded":"2024-09-16T06:46:39.380879+0000","last_fullsized":"2024-09-16T06:46:39.380879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:53.345033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379674+0000","last_change":"2024-09-16T06:46:39.195683+0000","last_active":"2024-09-16T06:46:39.379674+0000","last_peered":"2024-09-16T06:46:39.379674+0000","last_clean":"2024-09-16T06:46:39.379674+0000","last_became_active":"2024-09-16T06:46:39.195257+0000","last_became_peered":"2024-09-16T06:46:39.195257+0000","last_unstale":"2024-09-16T06:46:39.379674+0000","last_undegraded":"2024-09-16T06:46:39.379674+0000","last_fullsized":"2024-09-16T06:46:39.379674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:45.567439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574872+0000","last_change":"2024-09-16T06:46:38.845647+0000","last_active":"2024-09-16T06:46:39.574872+0000","last_peered":"2024-09-16T06:46:39.574872+0000","last_clean":"2024-09-16T06:46:39.574872+0000","last_became_active":"2024-09-16T06:46:38.842456+0000","last_became_peered":"2024-09-16T06:46:38.842456+0000","last_unstale":"2024-09-16T06:46:39.574872+0000","last_undegraded":"2024-09-16T06:46:39.574872+0000","last_fullsized":"2024-09-16T06:46:39.574872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373566+0000","last_change":"2024-09-16T06:46:39.165157+0000","last_active":"2024-09-16T06:46:39.373566+0000","last_peered":"2024-09-16T06:46:39.373566+0000","last_clean":"2024-09-16T06:46:39.373566+0000","last_became_active":"2024-09-16T06:46:39.164481+0000","last_became_peered":"2024-09-16T06:46:39.164481+0000","last_unstale":"2024-09-16T06:46:39.373566+0000","last_undegraded":"2024-09-16T06:46:39.373566+0000","last_fullsized":"2024-09-16T06:46:39.373566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:33.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374569+0000","last_change":"2024-09-16T06:46:38.811325+0000","last_active":"2024-09-16T06:46:39.374569+0000","last_peered":"2024-09-16T06:46:39.374569+0000","last_clean":"2024-09-16T06:46:39.374569+0000","last_became_active":"2024-09-16T06:46:38.811045+0000","last_became_peered":"2024-09-16T06:46:38.811045+0000","last_unstale":"2024-09-16T06:46:39.374569+0000","last_undegraded":"2024-09-16T06:46:39.374569+0000","last_fullsized":"2024-09-16T06:46:39.374569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:09.927559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379772+0000","last_change":"2024-09-16T06:46:39.201473+0000","last_active":"2024-09-16T06:46:39.379772+0000","last_peered":"2024-09-16T06:46:39.379772+0000","last_clean":"2024-09-16T06:46:39.379772+0000","last_became_active":"2024-09-16T06:46:39.195802+0000","last_became_peered":"2024-09-16T06:46:39.195802+0000","last_unstale":"2024-09-16T06:46:39.379772+0000","last_undegraded":"2024-09-16T06:46:39.379772+0000","last_fullsized":"2024-09-16T06:46:39.379772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382822+0000","last_change":"2024-09-16T06:46:38.818893+0000","last_active":"2024-09-16T06:46:39.382822+0000","last_peered":"2024-09-16T06:46:39.382822+0000","last_clean":"2024-09-16T06:46:39.382822+0000","last_became_active":"2024-09-16T06:46:38.818126+0000","last_became_peered":"2024-09-16T06:46:38.818126+0000","last_unstale":"2024-09-16T06:46:39.382822+0000","last_undegraded":"2024-09-16T06:46:39.382822+0000","last_fullsized":"2024-09-16T06:46:39.382822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:07:21.946452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373312+0000","last_change":"2024-09-16T06:46:39.181737+0000","last_active":"2024-09-16T06:46:39.373312+0000","last_peered":"2024-09-16T06:46:39.373312+0000","last_clean":"2024-09-16T06:46:39.373312+0000","last_became_active":"2024-09-16T06:46:39.181022+0000","last_became_peered":"2024-09-16T06:46:39.181022+0000","last_unstale":"2024-09-16T06:46:39.373312+0000","last_undegraded":"2024-09-16T06:46:39.373312+0000","last_fullsized":"2024-09-16T06:46:39.373312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574823+0000","last_change":"2024-09-16T06:46:38.845870+0000","last_active":"2024-09-16T06:46:39.574823+0000","last_peered":"2024-09-16T06:46:39.574823+0000","last_clean":"2024-09-16T06:46:39.574823+0000","last_became_active":"2024-09-16T06:46:38.837200+0000","last_became_peered":"2024-09-16T06:46:38.837200+0000","last_unstale":"2024-09-16T06:46:39.574823+0000","last_undegraded":"2024-09-16T06:46:39.574823+0000","last_fullsized":"2024-09-16T06:46:39.574823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":65043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":657453,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":655840,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":66558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T06:46:43.113 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-16T06:46:43.113 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T06:46:43.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T06:46:43.113 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T06:46:43.114 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T06:46:43.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f024599f640 1 Processor -- start 2024-09-16T06:46:43.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f024599f640 1 -- start start 2024-09-16T06:46:43.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f024599f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02400b4b50 0x7f02401430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f024599f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024006d010 con 0x7f024006e4b0 2024-09-16T06:46:43.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f024599f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02401470d0 con 0x7f0240142cf0 2024-09-16T06:46:43.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f024599f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0240147390 con 0x7f02400b4b50 2024-09-16T06:46:43.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f023f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02400b4b50 0x7f02401430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f023f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02400b4b50 0x7f02401430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59262/0 (socket says 172.21.15.96:59262) 2024-09-16T06:46:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f02367fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f024006e4b0 0x7f024014be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52368/0 (socket says 172.21.15.96:52368) 2024-09-16T06:46:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.259+0000 7f023f7fe640 1 -- 172.21.15.96:0/2954331967 learned_addr learned my addr 172.21.15.96:0/2954331967 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023f7fe640 1 -- 172.21.15.96:0/2954331967 >> v1:172.21.15.134:6789/0 conn(0x7f0240142cf0 legacy=0x7f024006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023f7fe640 1 -- 172.21.15.96:0/2954331967 >> v1:172.21.15.96:6789/0 conn(0x7f024006e4b0 legacy=0x7f024014be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023e7fc640 1 -- 172.21.15.96:0/2954331967 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46590378 0 0) 0x7f024006d010 con 0x7f024006e4b0 2024-09-16T06:46:43.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023f7fe640 1 -- 172.21.15.96:0/2954331967 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240147650 con 0x7f02400b4b50 2024-09-16T06:46:43.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023f7fe640 1 --2- 172.21.15.96:0/2954331967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02400b4b50 0x7f02401430d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0238009e50 tx=0x7f023801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1368caccbc11dbd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023e7fc640 1 -- 172.21.15.96:0/2954331967 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380a5820 con 0x7f02400b4b50 2024-09-16T06:46:43.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023e7fc640 1 -- 172.21.15.96:0/2954331967 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380a5980 con 0x7f02400b4b50 2024-09-16T06:46:43.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f023e7fc640 1 -- 172.21.15.96:0/2954331967 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380a5d10 con 0x7f02400b4b50 2024-09-16T06:46:43.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 -- 172.21.15.96:0/2954331967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02400b4b50 msgr2=0x7f02401430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 --2- 172.21.15.96:0/2954331967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02400b4b50 0x7f02401430d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0238009e50 tx=0x7f023801c940 comp rx=0 tx=0).stop 2024-09-16T06:46:43.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 -- 172.21.15.96:0/2954331967 shutdown_connections 2024-09-16T06:46:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 --2- 172.21.15.96:0/2954331967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02400b4b50 0x7f02401430d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 -- 172.21.15.96:0/2954331967 >> 172.21.15.96:0/2954331967 conn(0x7f024006b8a0 msgr2=0x7f02400a6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 -- 172.21.15.96:0/2954331967 shutdown_connections 2024-09-16T06:46:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 -- 172.21.15.96:0/2954331967 wait complete. 2024-09-16T06:46:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.263+0000 7f024599f640 1 Processor -- start 2024-09-16T06:46:43.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 -- start start 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f024006e4b0 0x7f02400b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02400b4b50 0x7f02400702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0240142cf0 0x7f0240141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0240135b60 con 0x7f0240142cf0 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024013fcd0 con 0x7f02400b4b50 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02400b51b0 con 0x7f024006e4b0 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023effd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f024006e4b0 0x7f02400b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0240142cf0 0x7f0240141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023effd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f024006e4b0 0x7f02400b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:55994/0 (socket says 172.21.15.96:55994) 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023effd640 1 -- 172.21.15.96:0/2614876510 learned_addr learned my addr 172.21.15.96:0/2614876510 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023f7fe640 1 -- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f024006e4b0 msgr2=0x7f02400b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023f7fe640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f024006e4b0 0x7f02400b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023f7fe640 1 -- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02400b4b50 msgr2=0x7f02400702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f02367fc640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02400b4b50 0x7f02400702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023f7fe640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02400b4b50 0x7f02400702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023f7fe640 1 -- 172.21.15.96:0/2614876510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0238009b30 con 0x7f0240142cf0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023effd640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f024006e4b0 0x7f02400b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023f7fe640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0240142cf0 0x7f0240141380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02380ab000 tx=0x7f02380196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023cff9640 1 -- 172.21.15.96:0/2614876510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238009250 con 0x7f0240142cf0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023cff9640 1 -- 172.21.15.96:0/2614876510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02380b8680 con 0x7f0240142cf0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0240132090 con 0x7f0240142cf0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023cff9640 1 -- 172.21.15.96:0/2614876510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02380b8a50 con 0x7f0240142cf0 2024-09-16T06:46:43.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02401323b0 con 0x7f0240142cf0 2024-09-16T06:46:43.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02400b5370 con 0x7f0240142cf0 2024-09-16T06:46:43.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023cff9640 1 -- 172.21.15.96:0/2614876510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f02380b8bb0 con 0x7f0240142cf0 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.267+0000 7f023cff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023cff9640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0220097840 0x7f0220099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023cff9640 1 -- 172.21.15.96:0/2614876510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f023815b6e0 con 0x7f0240142cf0 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023effd640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0220097840 0x7f0220099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023effd640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0220097840 0x7f0220099d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0228004470 tx=0x7f0228003700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.271+0000 7f023cff9640 1 -- 172.21.15.96:0/2614876510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0238128e80 con 0x7f0240142cf0 2024-09-16T06:46:43.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.463+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f02401430d0 con 0x7f0240142cf0 2024-09-16T06:46:43.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.467+0000 7f023cff9640 1 -- 172.21.15.96:0/2614876510 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+246688 (secure 0 0 0) 0x7f02380b8e60 con 0x7f0240142cf0 2024-09-16T06:46:43.474 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:43.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 10 mgrc shutdown 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0220097840 msgr2=0x7f0220099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0220097840 0x7f0220099d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0228004470 tx=0x7f0228003700 comp rx=0 tx=0).stop 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0240142cf0 msgr2=0x7f0240141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0240142cf0 0x7f0240141380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02380ab000 tx=0x7f02380196e0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 shutdown_connections 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0220097840 0x7f0220099d00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0240142cf0 0x7f0240141380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f02400b4b50 0x7f02400702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 --2- 172.21.15.96:0/2614876510 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f024006e4b0 0x7f02400b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 >> 172.21.15.96:0/2614876510 conn(0x7f024006b8a0 msgr2=0x7f02400a77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 shutdown_connections 2024-09-16T06:46:43.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.471+0000 7f024599f640 1 -- 172.21.15.96:0/2614876510 wait complete. 2024-09-16T06:46:43.493 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"z","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":468510839},{"type":"v1","addr":"172.21.15.134:6825","nonce":468510839}]},"active_addr":"172.21.15.134:6825/468510839","active_change":"2024-09-16T06:46:20.510554+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4114,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":4008004304}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1607342520}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":4259638959}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":23035690}]}]} 2024-09-16T06:46:43.499 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T06:46:43.499 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T06:46:43.499 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1ce4d60640 1 Processor -- start 2024-09-16T06:46:43.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1ce4d60640 1 -- start start 2024-09-16T06:46:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1ce4d60640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce01420c0 0x7f1ce006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1ce4d60640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1ce00a7cc0 0x7f1ce014bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1ce4d60640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce00aa960 con 0x7f1ce00b3e00 2024-09-16T06:46:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1ce4d60640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce00aac00 con 0x7f1ce00a7cc0 2024-09-16T06:46:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1ce4d60640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00a89b0 con 0x7f1ce01420c0 2024-09-16T06:46:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce01420c0 0x7f1ce006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce01420c0 0x7f1ce006fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56002/0 (socket says 172.21.15.96:56002) 2024-09-16T06:46:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 -- 172.21.15.96:0/3052158861 learned_addr learned my addr 172.21.15.96:0/3052158861 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 -- 172.21.15.96:0/3052158861 >> v2:172.21.15.134:3300/0 conn(0x7f1ce00a7cc0 msgr2=0x7f1ce014bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 --2- 172.21.15.96:0/3052158861 >> v2:172.21.15.134:3300/0 conn(0x7f1ce00a7cc0 0x7f1ce014bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 -- 172.21.15.96:0/3052158861 >> v1:172.21.15.134:6789/0 conn(0x7f1ce00b3e00 legacy=0x7f1ce00a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:43.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 -- 172.21.15.96:0/3052158861 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce00709f0 con 0x7f1ce01420c0 2024-09-16T06:46:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cde59c640 1 --2- 172.21.15.96:0/3052158861 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce01420c0 0x7f1ce006fb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009870 tx=0x7f1cd001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b4ddc855c6bed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cdd59a640 1 -- 172.21.15.96:0/3052158861 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00ab600 con 0x7f1ce01420c0 2024-09-16T06:46:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cdd59a640 1 -- 172.21.15.96:0/3052158861 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd00a7050 con 0x7f1ce01420c0 2024-09-16T06:46:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.647+0000 7f1cdd59a640 1 -- 172.21.15.96:0/3052158861 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00ab980 con 0x7f1ce01420c0 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/3052158861 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce01420c0 msgr2=0x7f1ce006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/3052158861 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce01420c0 0x7f1ce006fb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009870 tx=0x7f1cd001c3e0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/3052158861 shutdown_connections 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/3052158861 >> v2:172.21.15.134:3300/0 conn(0x7f1ce00a7cc0 0x7f1ce014bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/3052158861 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce01420c0 0x7f1ce006fb20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/3052158861 >> 172.21.15.96:0/3052158861 conn(0x7f1ce00b7b30 msgr2=0x7f1ce00b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/3052158861 shutdown_connections 2024-09-16T06:46:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/3052158861 wait complete. 2024-09-16T06:46:43.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 Processor -- start 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- start start 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce00a7cc0 0x7f1ce0144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ce00b3e00 0x7f1ce01436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce01420c0 0x7f1ce0137020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce013dc70 con 0x7f1ce01420c0 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0144ed0 con 0x7f1ce00b3e00 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0145190 con 0x7f1ce00a7cc0 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce01420c0 0x7f1ce0137020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce01420c0 0x7f1ce0137020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59282/0 (socket says 172.21.15.96:59282) 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 -- 172.21.15.96:0/2148079396 learned_addr learned my addr 172.21.15.96:0/2148079396 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cde59c640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce00a7cc0 0x7f1ce0144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cddd9b640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ce00b3e00 0x7f1ce01436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 -- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce00a7cc0 msgr2=0x7f1ce0144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce00a7cc0 0x7f1ce0144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 -- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ce00b3e00 msgr2=0x7f1ce01436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ce00b3e00 0x7f1ce01436a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 -- 172.21.15.96:0/2148079396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00094d0 con 0x7f1ce01420c0 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cded9d640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce01420c0 0x7f1ce0137020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b9e0 tx=0x7f1cd800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cceffd640 1 -- 172.21.15.96:0/2148079396 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800cb20 con 0x7f1ce01420c0 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cceffd640 1 -- 172.21.15.96:0/2148079396 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd800cca0 con 0x7f1ce01420c0 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce0142ec0 con 0x7f1ce01420c0 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1cceffd640 1 -- 172.21.15.96:0/2148079396 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8014680 con 0x7f1ce01420c0 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce0144a70 con 0x7f1ce01420c0 2024-09-16T06:46:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.651+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce006fb20 con 0x7f1ce01420c0 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cceffd640 1 -- 172.21.15.96:0/2148079396 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f1cd801d3b0 con 0x7f1ce01420c0 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cceffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cceffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cceffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cceffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cceffd640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1cc0097840 0x7f1cc0099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cceffd640 1 -- 172.21.15.96:0/2148079396 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f1cd80bff50 con 0x7f1ce01420c0 2024-09-16T06:46:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cde59c640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1cc0097840 0x7f1cc0099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.655+0000 7f1cde59c640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1cc0097840 0x7f1cc0099d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00ad000 tx=0x7f1cd00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.659+0000 7f1cceffd640 1 -- 172.21.15.96:0/2148079396 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1cd808d6f0 con 0x7f1ce01420c0 2024-09-16T06:46:43.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.803+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce00707d0 con 0x7f1ce01420c0 2024-09-16T06:46:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.807+0000 7f1cceffd640 1 -- 172.21.15.96:0/2148079396 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7f1cd8019090 con 0x7f1ce01420c0 2024-09-16T06:46:43.810 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:43.810 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 10 mgrc shutdown 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1cc0097840 msgr2=0x7f1cc0099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1cc0097840 0x7f1cc0099d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00ad000 tx=0x7f1cd00a6000 comp rx=0 tx=0).stop 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce01420c0 msgr2=0x7f1ce0137020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce01420c0 0x7f1ce0137020 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b9e0 tx=0x7f1cd800bea0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 shutdown_connections 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1cc0097840 0x7f1cc0099d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ce01420c0 0x7f1ce0137020 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ce00b3e00 0x7f1ce01436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 --2- 172.21.15.96:0/2148079396 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1ce00a7cc0 0x7f1ce0144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 >> 172.21.15.96:0/2148079396 conn(0x7f1ce00b7b30 msgr2=0x7f1ce00a99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 shutdown_connections 2024-09-16T06:46:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.811+0000 7f1ce4d60640 1 -- 172.21.15.96:0/2148079396 wait complete. 2024-09-16T06:46:43.828 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T06:46:43.829 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:43.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.931+0000 7fb13b2f4640 1 Processor -- start 2024-09-16T06:46:43.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.931+0000 7fb13b2f4640 1 -- start start 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb13414cf10 0x7fb13414f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13406a6d0 con 0x7fb134143180 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1340a4af0 con 0x7fb134146be0 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb134147b80 con 0x7fb13414cf10 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb139090640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb134143180 0x7fb1340a7090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52384/0 (socket says 172.21.15.96:52384) 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb139891640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb13414cf10 0x7fb13414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb139090640 1 -- 172.21.15.96:0/1699444731 learned_addr learned my addr 172.21.15.96:0/1699444731 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb12bfff640 1 -- 172.21.15.96:0/1699444731 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869064083 0 0) 0x7fb13406a6d0 con 0x7fb134143180 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb139891640 1 -- 172.21.15.96:0/1699444731 >> v1:172.21.15.134:6789/0 conn(0x7fb134146be0 legacy=0x7fb1340a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:43.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb139891640 1 -- 172.21.15.96:0/1699444731 >> v1:172.21.15.96:6789/0 conn(0x7fb134143180 legacy=0x7fb1340a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb139891640 1 -- 172.21.15.96:0/1699444731 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134147090 con 0x7fb13414cf10 2024-09-16T06:46:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb139891640 1 --2- 172.21.15.96:0/1699444731 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb13414cf10 0x7fb13414f300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009dc0 tx=0x7fb12c01c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3753944cc30d014f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb12bfff640 1 -- 172.21.15.96:0/1699444731 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0a57e0 con 0x7fb13414cf10 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb12bfff640 1 -- 172.21.15.96:0/1699444731 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0a5940 con 0x7fb13414cf10 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb12bfff640 1 -- 172.21.15.96:0/1699444731 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0a5cd0 con 0x7fb13414cf10 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- 172.21.15.96:0/1699444731 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb13414cf10 msgr2=0x7fb13414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/1699444731 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb13414cf10 0x7fb13414f300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009dc0 tx=0x7fb12c01c810 comp rx=0 tx=0).stop 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- 172.21.15.96:0/1699444731 shutdown_connections 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/1699444731 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb13414cf10 0x7fb13414f300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- 172.21.15.96:0/1699444731 >> 172.21.15.96:0/1699444731 conn(0x7fb13406b4a0 msgr2=0x7fb13406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- 172.21.15.96:0/1699444731 shutdown_connections 2024-09-16T06:46:43.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.935+0000 7fb13b2f4640 1 -- 172.21.15.96:0/1699444731 wait complete. 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 Processor -- start 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 -- start start 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb134143180 0x7fb134071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb134146be0 0x7fb13414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb13414cf10 0x7fb1340b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b6f80 con 0x7fb13414cf10 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13414b000 con 0x7fb134143180 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb134147ee0 con 0x7fb134146be0 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb139891640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb13414cf10 0x7fb1340b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13888f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb134146be0 0x7fb13414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb139891640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb13414cf10 0x7fb1340b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59298/0 (socket says 172.21.15.96:59298) 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb139891640 1 -- 172.21.15.96:0/23183674 learned_addr learned my addr 172.21.15.96:0/23183674 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13888f640 1 -- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb134143180 msgr2=0x7fb134071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13888f640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb134143180 0x7fb134071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13888f640 1 -- 172.21.15.96:0/23183674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb13414cf10 msgr2=0x7fb1340b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13888f640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb13414cf10 0x7fb1340b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13888f640 1 -- 172.21.15.96:0/23183674 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c009a70 con 0x7fb134146be0 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13888f640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb134146be0 0x7fb13414a6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb134146fc0 tx=0x7fb12400c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb129ffb640 1 -- 172.21.15.96:0/23183674 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124011790 con 0x7fb134146be0 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb129ffb640 1 -- 172.21.15.96:0/23183674 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1240118f0 con 0x7fb134146be0 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1341481a0 con 0x7fb134146be0 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb129ffb640 1 -- 172.21.15.96:0/23183674 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124011ce0 con 0x7fb134146be0 2024-09-16T06:46:43.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb134149ed0 con 0x7fb134146be0 2024-09-16T06:46:43.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1340a7090 con 0x7fb134146be0 2024-09-16T06:46:43.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb129ffb640 1 -- 172.21.15.96:0/23183674 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fb12401c460 con 0x7fb134146be0 2024-09-16T06:46:43.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.939+0000 7fb129ffb640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:43.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb129ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:43.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb129ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:43.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb129ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:43.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb129ffb640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb118097840 0x7fb118099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:43.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb129ffb640 1 -- 172.21.15.96:0/23183674 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fb1240c0630 con 0x7fb134146be0 2024-09-16T06:46:43.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb139090640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb118097840 0x7fb118099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:43.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb139090640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb118097840 0x7fb118099d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb130007fd0 tx=0x7fb130007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:43.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:43.943+0000 7fb129ffb640 1 -- 172.21.15.96:0/23183674 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb12408dca0 con 0x7fb134146be0 2024-09-16T06:46:44.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.091+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb13406a2f0 con 0x7fb134146be0 2024-09-16T06:46:44.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb129ffb640 1 -- 172.21.15.96:0/23183674 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7fb12408fbd0 con 0x7fb134146be0 2024-09-16T06:46:44.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:44.097 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 10 mgrc shutdown 2024-09-16T06:46:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb118097840 msgr2=0x7fb118099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb118097840 0x7fb118099d00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb130007fd0 tx=0x7fb130007960 comp rx=0 tx=0).stop 2024-09-16T06:46:44.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb134146be0 msgr2=0x7fb13414a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb134146be0 0x7fb13414a6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb134146fc0 tx=0x7fb12400c870 comp rx=0 tx=0).stop 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 shutdown_connections 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb118097840 0x7fb118099d00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb13414cf10 0x7fb1340b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb134146be0 0x7fb13414a6b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 --2- 172.21.15.96:0/23183674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb134143180 0x7fb134071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 >> 172.21.15.96:0/23183674 conn(0x7fb13406b4a0 msgr2=0x7fb1340a7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 shutdown_connections 2024-09-16T06:46:44.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.095+0000 7fb13b2f4640 1 -- 172.21.15.96:0/23183674 wait complete. 2024-09-16T06:46:44.115 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T06:46:44.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T06:46:44.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T06:46:44.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T06:46:44.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7f7b1cee6640 1 Processor -- start 2024-09-16T06:46:44.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5b0fe3640 1 Processor -- start 2024-09-16T06:46:44.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7f7b1cee6640 1 -- start start 2024-09-16T06:46:44.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5b0fe3640 1 -- start start 2024-09-16T06:46:44.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fdb2c6c2640 1 Processor -- start 2024-09-16T06:46:44.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5b0fe3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5ac0a7100 0x7fe5ac070b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fdb2c6c2640 1 -- start start 2024-09-16T06:46:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5b0fe3640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5ac137520 0x7fe5ac14bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5b0fe3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac0a74e0 con 0x7fe5ac0710d0 2024-09-16T06:46:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5b0fe3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac1426a0 con 0x7fe5ac0a7100 2024-09-16T06:46:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5b0fe3640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac06b1c0 con 0x7fe5ac137520 2024-09-16T06:46:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5aa59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5ac0a7100 0x7fe5ac070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5a9d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe5ac0710d0 0x7fe5ac144fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52398/0 (socket says 172.21.15.96:52398) 2024-09-16T06:46:44.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.219+0000 7fe5a9d9b640 1 -- 172.21.15.96:0/1054444480 learned_addr learned my addr 172.21.15.96:0/1054444480 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1cee6640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b180a4460 0x7f7b180a0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1cee6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b1806a330 0x7f7b180a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1cee6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b18140890 0x7f7b18140d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1cee6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b180a5710 con 0x7f7b18140890 2024-09-16T06:46:44.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1cee6640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b180a09b0 con 0x7f7b180a4460 2024-09-16T06:46:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1cee6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1806a730 con 0x7f7b1806a330 2024-09-16T06:46:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b18140890 0x7f7b18140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b18140890 0x7f7b18140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59314/0 (socket says 172.21.15.96:59314) 2024-09-16T06:46:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 -- 172.21.15.96:0/3537005857 learned_addr learned my addr 172.21.15.96:0/3537005857 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b15d9b640 1 --2- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b1806a330 0x7f7b180a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/1054444480 >> v2:172.21.15.134:3300/0 conn(0x7fe5ac137520 0x7fe5ac14bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1659c640 1 --2- 172.21.15.96:0/3537005857 >> v2:172.21.15.134:3300/0 conn(0x7f7b180a4460 0x7f7b180a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034633721 0 0) 0x7fe5ac0a74e0 con 0x7fe5ac0710d0 2024-09-16T06:46:44.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 -- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b1806a330 msgr2=0x7f7b180a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 --2- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b1806a330 0x7f7b180a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 -- 172.21.15.96:0/3537005857 >> v2:172.21.15.134:3300/0 conn(0x7f7b180a4460 msgr2=0x7f7b180a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 --2- 172.21.15.96:0/3537005857 >> v2:172.21.15.134:3300/0 conn(0x7f7b180a4460 0x7f7b180a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 -- 172.21.15.96:0/3537005857 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180a5df0 con 0x7f7b18140890 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2c6c2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a6a80 0x7fdb2414c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2c6c2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240a7420 con 0x7fdb240a8280 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2c6c2640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240a4150 con 0x7fdb240a4eb0 2024-09-16T06:46:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2c6c2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240a3cd0 con 0x7fdb240a6a80 2024-09-16T06:46:44.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe594003530 con 0x7fe5ac0710d0 2024-09-16T06:46:44.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206619812 0 0) 0x7fe594003530 con 0x7fe5ac0710d0 2024-09-16T06:46:44.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 >> v2:172.21.15.134:3300/0 conn(0x7fe5ac137520 msgr2=0x7fe5ac14bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 --2- 172.21.15.96:0/1054444480 >> v2:172.21.15.134:3300/0 conn(0x7fe5ac137520 0x7fe5ac14bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 >> v2:172.21.15.96:3300/0 conn(0x7fe5ac0a7100 msgr2=0x7fe5ac070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb29c5d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdb240a8280 0x7fdb24148b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52410/0 (socket says 172.21.15.96:52410) 2024-09-16T06:46:44.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb29c5d640 1 -- 172.21.15.96:0/903276793 learned_addr learned my addr 172.21.15.96:0/903276793 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 --2- 172.21.15.96:0/1054444480 >> v2:172.21.15.96:3300/0 conn(0x7fe5ac0a7100 0x7fe5ac070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac144cf0 con 0x7fe5ac0710d0 2024-09-16T06:46:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 633242010 0 0) 0x7fe59c001680 con 0x7fe5ac0710d0 2024-09-16T06:46:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 >> v1:172.21.15.96:6789/0 conn(0x7fe5ac0710d0 legacy=0x7fe5ac144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940039d0 0x7fe594003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5940047d0 0x7fe594004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe594005190 0x7fe59400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac1426a0 con 0x7fe5940047d0 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac06b1c0 con 0x7fe5940039d0 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59400bf80 con 0x7fe594005190 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a9d9b640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5940047d0 0x7fe594004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2ac5f640 1 --2- 172.21.15.96:0/903276793 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a6a80 0x7fdb2414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041070920 0 0) 0x7fdb240a7420 con 0x7fdb240a8280 2024-09-16T06:46:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb10003530 con 0x7fdb240a8280 2024-09-16T06:46:44.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/1054444480 >> v2:172.21.15.134:3300/0 conn(0x7fe5ac137520 0x7fe5ac14bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:44.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5aa59c640 1 --2- 172.21.15.96:0/1054444480 >> v2:172.21.15.96:3300/0 conn(0x7fe5ac0a7100 0x7fe5ac070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:44.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545764366 0 0) 0x7fdb240a4150 con 0x7fdb240a4eb0 2024-09-16T06:46:44.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb240a7420 con 0x7fdb240a4eb0 2024-09-16T06:46:44.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a9d9b640 1 -- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe594005190 msgr2=0x7fe59400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe594005190 0x7fe59400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0c276640 1 Processor -- start 2024-09-16T06:46:44.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0c276640 1 -- start start 2024-09-16T06:46:44.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2ac5f640 1 -- 172.21.15.96:0/903276793 >> v1:172.21.15.134:6789/0 conn(0x7fdb240a4eb0 legacy=0x7fdb240a7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2ac5f640 1 -- 172.21.15.96:0/903276793 >> v1:172.21.15.96:6789/0 conn(0x7fdb240a8280 legacy=0x7fdb24148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18851730 0 0) 0x7fdb10003530 con 0x7fdb240a8280 2024-09-16T06:46:44.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fdb2ac5f640 1 -- 172.21.15.96:0/903276793 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240a43d0 con 0x7fdb240a6a80 2024-09-16T06:46:44.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a9d9b640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe594005190 0x7fe59400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a9d9b640 1 -- 172.21.15.96:0/1054444480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940039d0 msgr2=0x7fe594003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a9d9b640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5940039d0 0x7fe594003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5a9d9b640 1 -- 172.21.15.96:0/1054444480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594003530 con 0x7fe5940047d0 2024-09-16T06:46:44.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe594005190 0x7fe59400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:44.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7fe5aad9d640 1 -- 172.21.15.96:0/1054444480 reap_dead start 2024-09-16T06:46:44.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0c276640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7c04069ce0 0x7f7c040a4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0c276640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0406c900 con 0x7f7c0406dc00 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0c276640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0406cb30 con 0x7f7c040a40a0 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0c276640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0406e0b0 con 0x7f7c04069ce0 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0a813640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7c0406dc00 0x7f7c04141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52418/0 (socket says 172.21.15.96:52418) 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c0a813640 1 -- 172.21.15.96:0/174904480 learned_addr learned my addr 172.21.15.96:0/174904480 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09811640 1 --2- 172.21.15.96:0/174904480 >> v2:172.21.15.134:3300/0 conn(0x7f7c04069ce0 0x7f7c040a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528839091 0 0) 0x7f7c0406c900 con 0x7f7c0406dc00 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf0003530 con 0x7f7c0406dc00 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1806108635 0 0) 0x7f7bf0003530 con 0x7f7c0406dc00 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 >> v2:172.21.15.134:3300/0 conn(0x7f7c04069ce0 msgr2=0x7f7c040a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 --2- 172.21.15.96:0/174904480 >> v2:172.21.15.134:3300/0 conn(0x7f7c04069ce0 0x7f7c040a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 >> v1:172.21.15.134:6789/0 conn(0x7f7c040a40a0 legacy=0x7f7c0406e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0406cdf0 con 0x7f7c0406dc00 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 633242010 0 0) 0x7f7bfc001a00 con 0x7f7c0406dc00 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 >> v1:172.21.15.96:6789/0 conn(0x7f7c0406dc00 legacy=0x7f7c04141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf0003980 0x7f7bf0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7bf0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7bf0005190 0x7f7bf000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf000c060 con 0x7f7bf00047d0 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf000c1d0 con 0x7f7bf0003980 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf000c390 con 0x7f7bf0005190 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b16d9d640 1 --2- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18140890 0x7f7b18140d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009e50 tx=0x7f7b10020ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d780677700133af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1559a640 1 -- 172.21.15.96:0/3537005857 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100a9a60 con 0x7f7b18140890 2024-09-16T06:46:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1559a640 1 -- 172.21.15.96:0/3537005857 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b100a9bc0 con 0x7f7b18140890 2024-09-16T06:46:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7b1559a640 1 -- 172.21.15.96:0/3537005857 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100b13f0 con 0x7f7b18140890 2024-09-16T06:46:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09811640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7bf0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.223+0000 7f7c09811640 1 -- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7bf0005190 msgr2=0x7f7bf000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c0a012640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf0003980 0x7f7bf0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2ac5f640 1 --2- 172.21.15.96:0/903276793 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a6a80 0x7fdb2414c230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009dc0 tx=0x7fdb1c01c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66188adc123998 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14001680 con 0x7fdb240a6a80 2024-09-16T06:46:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0a55d0 con 0x7fdb240a6a80 2024-09-16T06:46:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2945c640 1 -- 172.21.15.96:0/903276793 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0a5960 con 0x7fdb240a6a80 2024-09-16T06:46:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c0a813640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7bf0005190 0x7f7bf000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09811640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7bf0005190 0x7f7bf000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09811640 1 -- 172.21.15.96:0/174904480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf0003980 msgr2=0x7f7bf0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09811640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf0003980 0x7f7bf0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09811640 1 -- 172.21.15.96:0/174904480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0406cdf0 con 0x7f7bf00047d0 2024-09-16T06:46:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18140890 msgr2=0x7f7b18140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 --2- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18140890 0x7f7b18140d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009e50 tx=0x7f7b10020ce0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5a9d9b640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5940047d0 0x7fe594004c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c190 tx=0x7fe59c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c900897f60d824 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- 172.21.15.96:0/3537005857 shutdown_connections 2024-09-16T06:46:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 --2- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18140890 0x7f7b18140d20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 --2- 172.21.15.96:0/3537005857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b1806a330 0x7f7b180a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 --2- 172.21.15.96:0/3537005857 >> v2:172.21.15.134:3300/0 conn(0x7f7b180a4460 0x7f7b180a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- 172.21.15.96:0/3537005857 >> 172.21.15.96:0/3537005857 conn(0x7f7b1806b4a0 msgr2=0x7f7b1806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c0a012640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf0003980 0x7f7bf0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c0a813640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7bf0005190 0x7f7bf000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:44.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c0a813640 1 -- 172.21.15.96:0/174904480 reap_dead start 2024-09-16T06:46:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0a8c10 con 0x7fe5940047d0 2024-09-16T06:46:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c0a8d70 con 0x7fe5940047d0 2024-09-16T06:46:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5a959a640 1 -- 172.21.15.96:0/1054444480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c005b20 con 0x7fe5940047d0 2024-09-16T06:46:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- 172.21.15.96:0/3537005857 shutdown_connections 2024-09-16T06:46:44.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- 172.21.15.96:0/3537005857 wait complete. 2024-09-16T06:46:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/903276793 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a6a80 msgr2=0x7fdb2414c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 --2- 172.21.15.96:0/903276793 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a6a80 0x7fdb2414c230 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009dc0 tx=0x7fdb1c01c790 comp rx=0 tx=0).stop 2024-09-16T06:46:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/903276793 shutdown_connections 2024-09-16T06:46:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 --2- 172.21.15.96:0/903276793 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a6a80 0x7fdb2414c230 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/903276793 >> 172.21.15.96:0/903276793 conn(0x7fdb2406bcb0 msgr2=0x7fdb240a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/903276793 shutdown_connections 2024-09-16T06:46:44.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/903276793 wait complete. 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5940047d0 msgr2=0x7fe594004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5940047d0 0x7fe594004c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c190 tx=0x7fe59c01f1f0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/1054444480 shutdown_connections 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 --2- 172.21.15.96:0/1054444480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5940047d0 0x7fe594004c50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/1054444480 >> 172.21.15.96:0/1054444480 conn(0x7fe5ac06b4a0 msgr2=0x7fe5ac0a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/1054444480 shutdown_connections 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/1054444480 wait complete. 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 Processor -- start 2024-09-16T06:46:44.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- start start 2024-09-16T06:46:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 Processor -- start 2024-09-16T06:46:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- start start 2024-09-16T06:46:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 Processor -- start 2024-09-16T06:46:44.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fe5b0fe3640 1 -- start start 2024-09-16T06:46:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b1806a330 0x7f7b1813f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b180a4460 0x7f7b18099020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b18140890 0x7f7b181da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181dacf0 con 0x7f7b1806a330 2024-09-16T06:46:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181daf00 con 0x7f7b180a4460 2024-09-16T06:46:44.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1cee6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181db1c0 con 0x7f7b18140890 2024-09-16T06:46:44.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb240a4eb0 0x7fdb2412f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb240a6a80 0x7fdb2414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a8280 0x7fdb2412db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2412e760 con 0x7fdb240a4eb0 2024-09-16T06:46:44.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2412f910 con 0x7fdb240a6a80 2024-09-16T06:46:44.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2c6c2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb241dee50 con 0x7fdb240a8280 2024-09-16T06:46:44.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09811640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7bf0004c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009ae0 tx=0x7f7c0001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f9ba605890b2a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b1806a330 0x7f7b1813f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b1806a330 0x7f7b1813f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59346/0 (socket says 172.21.15.96:59346) 2024-09-16T06:46:44.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b1659c640 1 -- 172.21.15.96:0/1311867234 learned_addr learned my addr 172.21.15.96:0/1311867234 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2a45e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb240a4eb0 0x7fdb2412f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2a45e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb240a4eb0 0x7fdb2412f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59360/0 (socket says 172.21.15.96:59360) 2024-09-16T06:46:44.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2a45e640 1 -- 172.21.15.96:0/967346926 learned_addr learned my addr 172.21.15.96:0/967346926 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2ac5f640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a8280 0x7fdb2412db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000a4b90 con 0x7f7bf00047d0 2024-09-16T06:46:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b16d9d640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b18140890 0x7f7b181da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7b15d9b640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b180a4460 0x7f7b18099020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2a45e640 1 -- 172.21.15.96:0/967346926 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a8280 msgr2=0x7fdb2412db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2a45e640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdb240a8280 0x7fdb2412db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb2a45e640 1 -- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb240a6a80 msgr2=0x7fdb2414b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c000a4cf0 con 0x7f7bf00047d0 2024-09-16T06:46:44.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7f7c09010640 1 -- 172.21.15.96:0/174904480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000a4ea0 con 0x7f7bf00047d0 2024-09-16T06:46:44.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5ac0b7620 0x7fe5ac132120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b16d9d640 1 -- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b180a4460 msgr2=0x7f7b18099020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b16d9d640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b180a4460 0x7f7b18099020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b16d9d640 1 -- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b1806a330 msgr2=0x7f7b1813f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b16d9d640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b1806a330 0x7f7b1813f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b16d9d640 1 -- 172.21.15.96:0/1311867234 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10009b30 con 0x7f7b18140890 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac0b7a00 0x7fe5ac1409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5ac0b7620 0x7fe5ac132120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5ac0b7620 0x7fe5ac132120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59372/0 (socket says 172.21.15.96:59372) 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5ac140f20 0x7fe5ac1d5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac141670 con 0x7fe5ac0b7620 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac132660 con 0x7fe5ac0b7a00 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 -- 172.21.15.96:0/3250307419 learned_addr learned my addr 172.21.15.96:0/3250307419 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac1413b0 con 0x7fe5ac140f20 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b1659c640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b1806a330 0x7f7b1813f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b16d9d640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b18140890 0x7f7b181da7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b100af000 tx=0x7f7b1001da80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5ac140f20 0x7fe5ac1d5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 -- 172.21.15.96:0/3250307419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5ac140f20 msgr2=0x7fe5ac1d5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5ac140f20 0x7fe5ac1d5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 -- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac0b7a00 msgr2=0x7fe5ac1409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ac0b7a00 0x7fe5ac1409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac12ddb0 con 0x7fe5ac0b7620 2024-09-16T06:46:44.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5ac140f20 0x7fe5ac1d5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:44.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7c0c276640 1 -- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 msgr2=0x7f7bf0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7c0c276640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7bf0004c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009ae0 tx=0x7f7c0001c730 comp rx=0 tx=0).stop 2024-09-16T06:46:44.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100a9a60 con 0x7f7b18140890 2024-09-16T06:46:44.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5aa59c640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5ac0b7620 0x7fe5ac132120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000e920 tx=0x7fe5a000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18098a70 con 0x7f7b18140890 2024-09-16T06:46:44.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.227+0000 7fdb29c5d640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb240a6a80 0x7fdb2414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7c0c276640 1 -- 172.21.15.96:0/174904480 shutdown_connections 2024-09-16T06:46:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7c0c276640 1 --2- 172.21.15.96:0/174904480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7bf0004c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7c0c276640 1 -- 172.21.15.96:0/174904480 >> 172.21.15.96:0/174904480 conn(0x7f7c0406bcb0 msgr2=0x7f7c040a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b181cd550 con 0x7f7b18140890 2024-09-16T06:46:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb2a45e640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb240a6a80 0x7fdb2414b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb2a45e640 1 -- 172.21.15.96:0/967346926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c009a70 con 0x7fdb240a4eb0 2024-09-16T06:46:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000ca00 con 0x7fe5ac0b7620 2024-09-16T06:46:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb29c5d640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb240a6a80 0x7fdb2414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000cb80 con 0x7fe5ac0b7620 2024-09-16T06:46:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac141f90 con 0x7fe5ac0b7620 2024-09-16T06:46:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7c0c276640 1 -- 172.21.15.96:0/174904480 shutdown_connections 2024-09-16T06:46:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b10009510 con 0x7f7b18140890 2024-09-16T06:46:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10007d20 con 0x7f7b18140890 2024-09-16T06:46:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7afc000f20 con 0x7f7b18140890 2024-09-16T06:46:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb2a45e640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb240a4eb0 0x7fdb2412f3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c4c0 tx=0x7fdb2000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0004030 con 0x7fe5ac0b7620 2024-09-16T06:46:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb200052d0 con 0x7fdb240a4eb0 2024-09-16T06:46:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20005430 con 0x7fdb240a4eb0 2024-09-16T06:46:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb240a8bc0 con 0x7fdb240a4eb0 2024-09-16T06:46:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20012870 con 0x7fdb240a4eb0 2024-09-16T06:46:44.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2412e940 con 0x7fdb240a4eb0 2024-09-16T06:46:44.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7c0c276640 1 -- 172.21.15.96:0/174904480 wait complete. 2024-09-16T06:46:44.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb241df1c0 con 0x7fdb240a4eb0 2024-09-16T06:46:44.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac1d5f90 con 0x7fe5ac0b7620 2024-09-16T06:46:44.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fe5a0004190 con 0x7fe5ac0b7620 2024-09-16T06:46:44.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5ac0a3b20 con 0x7fe5ac0b7620 2024-09-16T06:46:44.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7fe59affd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f7b100bc470 con 0x7f7b18140890 2024-09-16T06:46:44.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.231+0000 7f7b06ffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 Processor -- start 2024-09-16T06:46:44.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 -- start start 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7af8097910 0x7f7af8099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f7b1015faa0 con 0x7f7b18140890 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x7f7af809f4e0 0x7f7af80a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 --> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7af80a2010 con 0x7f7af809f4e0 2024-09-16T06:46:44.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1015fef0 con 0x7f7b18140890 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7c040a7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c0413af30 0x7f7c040adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c040ac020 0x7f7c040ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040ad200 con 0x7f7bf00047d0 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0413b3e0 con 0x7f7c040ac020 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0413b6a0 con 0x7f7c0413af30 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c0413af30 0x7f7c040adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c0413af30 0x7f7c040adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56074/0 (socket says 172.21.15.96:56074) 2024-09-16T06:46:44.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 -- 172.21.15.96:0/827383018 learned_addr learned my addr 172.21.15.96:0/827383018 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b1659c640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7af8097910 0x7f7af8099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b15d9b640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x7f7af809f4e0 0x7f7af80a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe58c097840 0x7fe58c099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fe5a00c18b0 con 0x7fe5ac0b7620 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6800/1898754954,v1:172.21.15.134:6801/1898754954] conn(0x7fe58c09f410 0x7fe58c0a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.134:6800/1898754954,v1:172.21.15.134:6801/1898754954] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe58c0a1f40 con 0x7fe58c09f410 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5a00c1c30 con 0x7fe5ac0b7620 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe5a9d9b640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe58c097840 0x7fe58c099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fdb200129d0 con 0x7fdb240a4eb0 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fdb08097870 0x7fdb08099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fdb200bf850 con 0x7fdb240a4eb0 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6810/3839387097,v1:172.21.15.134:6812/3839387097] conn(0x7fdb0809f440 0x7fdb080a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 --> [v2:172.21.15.134:6810/3839387097,v1:172.21.15.134:6812/3839387097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb080a1f70 con 0x7fdb0809f440 2024-09-16T06:46:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6800/1898754954,v1:172.21.15.134:6801/1898754954] conn(0x7fe58c09f410 0x7fe58c0a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb2008cf60 con 0x7fdb240a4eb0 2024-09-16T06:46:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0a813640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c040ac020 0x7f7c040ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0a012640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7c040a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb2ac5f640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6810/3839387097,v1:172.21.15.134:6812/3839387097] conn(0x7fdb0809f440 0x7fdb080a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 -- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c040ac020 msgr2=0x7f7c040ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c040ac020 0x7f7c040ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 -- 172.21.15.96:0/827383018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 msgr2=0x7f7c040a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bf00047d0 0x7f7c040a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 -- 172.21.15.96:0/827383018 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040a8430 con 0x7f7c0413af30 2024-09-16T06:46:44.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b15d9b640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x7f7af809f4e0 0x7f7af80a1940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c09811640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c0413af30 0x7f7c040adc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c0001cfd0 tx=0x7f7bf0005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000acc40 con 0x7f7c0413af30 2024-09-16T06:46:44.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe5a9d9b640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe58c097840 0x7fe58c099d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c160 tx=0x7fe5ac071a70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fe5aad9d640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6800/1898754954,v1:172.21.15.134:6801/1898754954] conn(0x7fe58c09f410 0x7fe58c0a1870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b1659c640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7af8097910 0x7f7af8099dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b08011310 tx=0x7f7b08009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c000acda0 con 0x7f7c0413af30 2024-09-16T06:46:44.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c040ae1d0 con 0x7f7c0413af30 2024-09-16T06:46:44.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000b5670 con 0x7f7c0413af30 2024-09-16T06:46:44.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0413ed10 con 0x7f7c0413af30 2024-09-16T06:46:44.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7fdb2ac5f640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6810/3839387097,v1:172.21.15.134:6812/3839387097] conn(0x7fdb0809f440 0x7fdb080a18a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== osd.0 v2:172.21.15.96:6800/3062669068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7af80a2010 con 0x7f7af809f4e0 2024-09-16T06:46:44.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.235+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c040a85c0 con 0x7f7c0413af30 2024-09-16T06:46:44.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.239+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== osd.3 v2:172.21.15.134:6800/1898754954 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe58c0a1f40 con 0x7fe58c09f410 2024-09-16T06:46:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.239+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== osd.2 v2:172.21.15.134:6810/3839387097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdb080a1f70 con 0x7fdb0809f440 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f7c000b3040 con 0x7f7c0413af30 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7be80978c0 0x7f7be8099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f7c00159900 con 0x7f7c0413af30 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6808/817883253,v1:172.21.15.134:6809/817883253] conn(0x7f7be809f490 0x7f7be80a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 --> [v2:172.21.15.134:6808/817883253,v1:172.21.15.134:6809/817883253] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7be80a1fc0 con 0x7f7be809f490 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c00159cb0 con 0x7f7c0413af30 2024-09-16T06:46:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7c0a813640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6808/817883253,v1:172.21.15.134:6809/817883253] conn(0x7f7be809f490 0x7f7be80a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.243+0000 7f7c0a813640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6808/817883253,v1:172.21.15.134:6809/817883253] conn(0x7f7be809f490 0x7f7be80a18f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.247+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== osd.1 v2:172.21.15.134:6808/817883253 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7be80a1fc0 con 0x7f7be809f490 2024-09-16T06:46:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 --> [v2:172.21.15.134:6800/1898754954,v1:172.21.15.134:6801/1898754954] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe5ac144990 con 0x7fe58c09f410 2024-09-16T06:46:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe59affd640 1 -- 172.21.15.96:0/3250307419 <== osd.3 v2:172.21.15.134:6800/1898754954 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe5a40083a0 con 0x7fe58c09f410 2024-09-16T06:46:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 --> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7afc002b60 con 0x7f7af809f4e0 2024-09-16T06:46:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6800/1898754954,v1:172.21.15.134:6801/1898754954] conn(0x7fe58c09f410 msgr2=0x7fe58c0a1870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6800/1898754954,v1:172.21.15.134:6801/1898754954] conn(0x7fe58c09f410 0x7fe58c0a1870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 10 mgrc shutdown 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe58c097840 msgr2=0x7fe58c099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe58c097840 0x7fe58c099d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00c160 tx=0x7fe5ac071a70 comp rx=0 tx=0).stop 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5ac0b7620 msgr2=0x7fe5ac132120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 --2- 172.21.15.96:0/3250307419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5ac0b7620 0x7fe5ac132120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000e920 tx=0x7fe5a000ede0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5aad9d640 1 -- 172.21.15.96:0/3250307419 reap_dead start 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 shutdown_connections 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 >> 172.21.15.96:0/3250307419 conn(0x7fe5ac06b4a0 msgr2=0x7fe5ac144fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 shutdown_connections 2024-09-16T06:46:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fe5b0fe3640 1 -- 172.21.15.96:0/3250307419 wait complete. 2024-09-16T06:46:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7f7b06ffd640 1 -- 172.21.15.96:0/1311867234 <== osd.0 v2:172.21.15.96:6800/3062669068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7afc002b60 con 0x7f7af809f4e0 2024-09-16T06:46:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.251+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 --> [v2:172.21.15.134:6810/3839387097,v1:172.21.15.134:6812/3839387097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb240a8a40 con 0x7fdb0809f440 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x7f7af809f4e0 msgr2=0x7f7af80a1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:6800/3062669068,v1:172.21.15.96:6801/3062669068] conn(0x7f7af809f4e0 0x7f7af80a1940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 10 mgrc shutdown 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7af8097910 msgr2=0x7f7af8099dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7af8097910 0x7f7af8099dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b08011310 tx=0x7f7b08009190 comp rx=0 tx=0).stop 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b18140890 msgr2=0x7f7b181da7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 --2- 172.21.15.96:0/1311867234 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7b18140890 0x7f7b181da7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b100af000 tx=0x7f7b1001da80 comp rx=0 tx=0).stop 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b16d9d640 1 -- 172.21.15.96:0/1311867234 reap_dead start 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 shutdown_connections 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 >> 172.21.15.96:0/1311867234 conn(0x7f7b1806b4a0 msgr2=0x7f7b1813c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 shutdown_connections 2024-09-16T06:46:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7f7b1cee6640 1 -- 172.21.15.96:0/1311867234 wait complete. 2024-09-16T06:46:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb1affd640 1 -- 172.21.15.96:0/967346926 <== osd.2 v2:172.21.15.134:6810/3839387097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdb1c009450 con 0x7fdb0809f440 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6810/3839387097,v1:172.21.15.134:6812/3839387097] conn(0x7fdb0809f440 msgr2=0x7fdb080a18a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6810/3839387097,v1:172.21.15.134:6812/3839387097] conn(0x7fdb0809f440 0x7fdb080a18a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 10 mgrc shutdown 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fdb08097870 msgr2=0x7fdb08099d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fdb08097870 0x7fdb08099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb240a4eb0 msgr2=0x7fdb2412f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 --2- 172.21.15.96:0/967346926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb240a4eb0 0x7fdb2412f3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c4c0 tx=0x7fdb2000c980 comp rx=0 tx=0).stop 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2ac5f640 1 -- 172.21.15.96:0/967346926 reap_dead start 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 shutdown_connections 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 >> 172.21.15.96:0/967346926 conn(0x7fdb2406bcb0 msgr2=0x7fdb24070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 shutdown_connections 2024-09-16T06:46:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.255+0000 7fdb2c6c2640 1 -- 172.21.15.96:0/967346926 wait complete. 2024-09-16T06:46:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.259+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 --> [v2:172.21.15.134:6808/817883253,v1:172.21.15.134:6809/817883253] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c040acc30 con 0x7f7be809f490 2024-09-16T06:46:44.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7bfaffd640 1 -- 172.21.15.96:0/827383018 <== osd.1 v2:172.21.15.134:6808/817883253 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c040acc30 con 0x7f7be809f490 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6808/817883253,v1:172.21.15.134:6809/817883253] conn(0x7f7be809f490 msgr2=0x7f7be80a18f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6808/817883253,v1:172.21.15.134:6809/817883253] conn(0x7f7be809f490 0x7f7be80a18f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 10 mgrc shutdown 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7be80978c0 msgr2=0x7f7be8099d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f7be80978c0 0x7f7be8099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c0413af30 msgr2=0x7f7c040adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 --2- 172.21.15.96:0/827383018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c0413af30 0x7f7c040adc90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c0001cfd0 tx=0x7f7bf0005800 comp rx=0 tx=0).stop 2024-09-16T06:46:44.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0a813640 1 -- 172.21.15.96:0/827383018 reap_dead start 2024-09-16T06:46:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 shutdown_connections 2024-09-16T06:46:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 >> 172.21.15.96:0/827383018 conn(0x7f7c0406bcb0 msgr2=0x7f7c040b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 shutdown_connections 2024-09-16T06:46:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.263+0000 7f7c0c276640 1 -- 172.21.15.96:0/827383018 wait complete. 2024-09-16T06:46:44.285 INFO:teuthology.orchestra.run.smithi096.stdout:38654705671 2024-09-16T06:46:44.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T06:46:44.287 INFO:teuthology.orchestra.run.smithi096.stdout:38654705672 2024-09-16T06:46:44.287 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T06:46:44.288 INFO:teuthology.orchestra.run.smithi096.stdout:38654705670 2024-09-16T06:46:44.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T06:46:44.289 INFO:teuthology.orchestra.run.smithi096.stdout:38654705671 2024-09-16T06:46:44.289 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T06:46:44.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1c0e62640 1 Processor -- start 2024-09-16T06:46:44.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 Processor -- start 2024-09-16T06:46:44.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1c0e62640 1 -- start start 2024-09-16T06:46:44.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 -- start start 2024-09-16T06:46:44.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8c53b1640 1 Processor -- start 2024-09-16T06:46:44.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8c53b1640 1 -- start start 2024-09-16T06:46:44.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1c0e62640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1bc1453b0 0x7fd1bc070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9f780a44c0 0x7f9f7806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9f780a6af0 0x7f9f78069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1c0e62640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc144a70 con 0x7fd1bc149d90 2024-09-16T06:46:44.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1c0e62640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc071210 con 0x7fd1bc06b4a0 2024-09-16T06:46:44.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1c0e62640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc0708f0 con 0x7fd1bc1453b0 2024-09-16T06:46:44.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1bad9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd1bc149d90 0x7fd1bc14c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52426/0 (socket says 172.21.15.96:52426) 2024-09-16T06:46:44.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1bad9d640 1 -- 172.21.15.96:0/1326007122 learned_addr learned my addr 172.21.15.96:0/1326007122 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:44.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7806df70 con 0x7f9f780a6af0 2024-09-16T06:46:44.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56090/0 (socket says 172.21.15.96:56090) 2024-09-16T06:46:44.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 -- 172.21.15.96:0/3002067450 learned_addr learned my addr 172.21.15.96:0/3002067450 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f76ffd640 1 --2- 172.21.15.96:0/3002067450 >> v2:172.21.15.96:3300/0 conn(0x7f9f780a6af0 0x7f9f78069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3002067450 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f780a6fe0 con 0x7f9f780a44c0 2024-09-16T06:46:44.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3002067450 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780a72a0 con 0x7f9f781470f0 2024-09-16T06:46:44.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1ba59c640 1 --2- 172.21.15.96:0/1326007122 >> v2:172.21.15.134:3300/0 conn(0x7fd1bc1453b0 0x7fd1bc070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f777fe640 1 --2- 172.21.15.96:0/3002067450 >> v2:172.21.15.134:3300/0 conn(0x7f9f780a44c0 0x7f9f7806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8c53b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0147760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 -- 172.21.15.96:0/3002067450 >> v2:172.21.15.134:3300/0 conn(0x7f9f780a44c0 msgr2=0x7f9f7806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 --2- 172.21.15.96:0/3002067450 >> v2:172.21.15.134:3300/0 conn(0x7f9f780a44c0 0x7f9f7806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1b9d9b640 1 -- 172.21.15.96:0/1326007122 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188209806 0 0) 0x7fd1bc144a70 con 0x7fd1bc149d90 2024-09-16T06:46:44.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1b9d9b640 1 -- 172.21.15.96:0/1326007122 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003530 con 0x7fd1bc149d90 2024-09-16T06:46:44.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 -- 172.21.15.96:0/3002067450 >> v2:172.21.15.96:3300/0 conn(0x7f9f780a6af0 msgr2=0x7f9f78069dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 --2- 172.21.15.96:0/3002067450 >> v2:172.21.15.96:3300/0 conn(0x7f9f780a6af0 0x7f9f78069dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9f77fff640 1 -- 172.21.15.96:0/3002067450 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780a4e40 con 0x7f9f781470f0 2024-09-16T06:46:44.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8c53b1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c00b3cf0 con 0x7fa8c00a40d0 2024-09-16T06:46:44.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8be7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8c53b1640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c00a6b90 con 0x7fa8c014bf70 2024-09-16T06:46:44.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8c53b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00a6580 con 0x7fa8c0147340 2024-09-16T06:46:44.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8be7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56098/0 (socket says 172.21.15.96:56098) 2024-09-16T06:46:44.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8be7fc640 1 -- 172.21.15.96:0/752615385 learned_addr learned my addr 172.21.15.96:0/752615385 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1ba59c640 1 -- 172.21.15.96:0/1326007122 >> v1:172.21.15.134:6789/0 conn(0x7fd1bc06b4a0 legacy=0x7fd1bc0a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1ba59c640 1 -- 172.21.15.96:0/1326007122 >> v1:172.21.15.96:6789/0 conn(0x7fd1bc149d90 legacy=0x7fd1bc14c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1b9d9b640 1 -- 172.21.15.96:0/1326007122 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329737178 0 0) 0x7fd1a8003530 con 0x7fd1bc149d90 2024-09-16T06:46:44.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fd1ba59c640 1 -- 172.21.15.96:0/1326007122 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc144ca0 con 0x7fd1bc1453b0 2024-09-16T06:46:44.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8be7fc640 1 -- 172.21.15.96:0/752615385 >> v1:172.21.15.134:6789/0 conn(0x7fa8c014bf70 legacy=0x7fa8c014e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8be7fc640 1 -- 172.21.15.96:0/752615385 >> v1:172.21.15.96:6789/0 conn(0x7fa8c00a40d0 legacy=0x7fa8c00a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7fa8be7fc640 1 -- 172.21.15.96:0/752615385 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00a6e30 con 0x7fa8c0147340 2024-09-16T06:46:44.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 Processor -- start 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 -- start start 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d480a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9d480a7b70 0x7f9d480a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9d481437a0 0x7f9d48143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d480a7420 con 0x7f9d480a7b70 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d480a4150 con 0x7f9d481437a0 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d45d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9d480a7b70 0x7f9d480a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4659c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d480a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d45d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9d480a7b70 0x7f9d480a7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59416/0 (socket says 172.21.15.96:59416) 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.435+0000 7f9d4c9b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480a3cd0 con 0x7f9d480a4eb0 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d45d9b640 1 -- 172.21.15.96:0/3584217308 learned_addr learned my addr 172.21.15.96:0/3584217308 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d46d9d640 1 --2- 172.21.15.96:0/3584217308 >> v2:172.21.15.134:3300/0 conn(0x7f9d481437a0 0x7f9d48143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4659c640 1 -- 172.21.15.96:0/3584217308 >> v2:172.21.15.134:3300/0 conn(0x7f9d481437a0 msgr2=0x7f9d48143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4659c640 1 --2- 172.21.15.96:0/3584217308 >> v2:172.21.15.134:3300/0 conn(0x7f9d481437a0 0x7f9d48143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4659c640 1 -- 172.21.15.96:0/3584217308 >> v2:172.21.15.96:3300/0 conn(0x7f9d480a7b70 msgr2=0x7f9d480a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4659c640 1 --2- 172.21.15.96:0/3584217308 >> v2:172.21.15.96:3300/0 conn(0x7f9d480a7b70 0x7f9d480a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4659c640 1 -- 172.21.15.96:0/3584217308 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480a43d0 con 0x7f9d480a4eb0 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d45d9b640 1 --2- 172.21.15.96:0/3584217308 >> v2:172.21.15.96:3300/0 conn(0x7f9d480a7b70 0x7f9d480a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f77fff640 1 --2- 172.21.15.96:0/3002067450 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f780a6220 tx=0x7f9f7001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91efb156570ae7be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f767fc640 1 -- 172.21.15.96:0/3002067450 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700a5720 con 0x7f9f781470f0 2024-09-16T06:46:44.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f767fc640 1 -- 172.21.15.96:0/3002067450 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700a5880 con 0x7f9f781470f0 2024-09-16T06:46:44.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f767fc640 1 -- 172.21.15.96:0/3002067450 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700a5c10 con 0x7f9f781470f0 2024-09-16T06:46:44.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1ba59c640 1 --2- 172.21.15.96:0/1326007122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc070280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc144e90 tx=0x7fd1ac020690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79406cab843cf0b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1b9d9b640 1 -- 172.21.15.96:0/1326007122 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4001a00 con 0x7fd1bc1453b0 2024-09-16T06:46:44.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1b9d9b640 1 -- 172.21.15.96:0/1326007122 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0aa510 con 0x7fd1bc1453b0 2024-09-16T06:46:44.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1b9d9b640 1 -- 172.21.15.96:0/1326007122 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0aa680 con 0x7fd1bc1453b0 2024-09-16T06:46:44.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3002067450 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 msgr2=0x7f9f78147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3002067450 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f780a6220 tx=0x7f9f7001c940 comp rx=0 tx=0).stop 2024-09-16T06:46:44.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8be7fc640 1 --2- 172.21.15.96:0/752615385 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0147760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40098a0 tx=0x7fa8b401c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d444b5a48827c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3002067450 shutdown_connections 2024-09-16T06:46:44.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3002067450 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3002067450 >> v2:172.21.15.96:3300/0 conn(0x7f9f780a6af0 0x7f9f78069dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3002067450 >> v2:172.21.15.134:3300/0 conn(0x7f9f780a44c0 0x7f9f7806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3002067450 >> 172.21.15.96:0/3002067450 conn(0x7f9f7806bcb0 msgr2=0x7f9f780a56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8bdffb640 1 -- 172.21.15.96:0/752615385 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40aa650 con 0x7fa8c0147340 2024-09-16T06:46:44.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8bdffb640 1 -- 172.21.15.96:0/752615385 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b40aa7b0 con 0x7fa8c0147340 2024-09-16T06:46:44.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8bdffb640 1 -- 172.21.15.96:0/752615385 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40aab40 con 0x7fa8c0147340 2024-09-16T06:46:44.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 -- 172.21.15.96:0/1326007122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc1453b0 msgr2=0x7fd1bc070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/1326007122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc070280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc144e90 tx=0x7fd1ac020690 comp rx=0 tx=0).stop 2024-09-16T06:46:44.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 -- 172.21.15.96:0/1326007122 shutdown_connections 2024-09-16T06:46:44.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/1326007122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc070280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 -- 172.21.15.96:0/1326007122 >> 172.21.15.96:0/1326007122 conn(0x7fd1bc072d70 msgr2=0x7fd1bc073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3002067450 shutdown_connections 2024-09-16T06:46:44.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 -- 172.21.15.96:0/1326007122 shutdown_connections 2024-09-16T06:46:44.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3002067450 wait complete. 2024-09-16T06:46:44.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 -- 172.21.15.96:0/1326007122 wait complete. 2024-09-16T06:46:44.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8c53b1640 1 -- 172.21.15.96:0/752615385 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 msgr2=0x7fa8c0147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/752615385 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0147760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40098a0 tx=0x7fa8b401c4f0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8c53b1640 1 -- 172.21.15.96:0/752615385 shutdown_connections 2024-09-16T06:46:44.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/752615385 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0147760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8c53b1640 1 -- 172.21.15.96:0/752615385 >> 172.21.15.96:0/752615385 conn(0x7fa8c006bb60 msgr2=0x7fa8c00a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8c53b1640 1 -- 172.21.15.96:0/752615385 shutdown_connections 2024-09-16T06:46:44.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fa8c53b1640 1 -- 172.21.15.96:0/752615385 wait complete. 2024-09-16T06:46:44.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4659c640 1 --2- 172.21.15.96:0/3584217308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d480a6a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d480a45c0 tx=0x7f9d3801c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa65bdaf51953f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4559a640 1 -- 172.21.15.96:0/3584217308 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380ab600 con 0x7f9d480a4eb0 2024-09-16T06:46:44.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4559a640 1 -- 172.21.15.96:0/3584217308 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d380a7050 con 0x7f9d480a4eb0 2024-09-16T06:46:44.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9d4559a640 1 -- 172.21.15.96:0/3584217308 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380ab980 con 0x7f9d480a4eb0 2024-09-16T06:46:44.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 Processor -- start 2024-09-16T06:46:44.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7fd1c0e62640 1 -- start start 2024-09-16T06:46:44.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 Processor -- start 2024-09-16T06:46:44.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.439+0000 7f9f7e10d640 1 -- start start 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3584217308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 msgr2=0x7f9d480a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3584217308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d480a6a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d480a45c0 tx=0x7f9d3801c320 comp rx=0 tx=0).stop 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3584217308 shutdown_connections 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3584217308 >> v2:172.21.15.134:3300/0 conn(0x7f9d481437a0 0x7f9d48143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3584217308 >> v2:172.21.15.96:3300/0 conn(0x7f9d480a7b70 0x7f9d480a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3584217308 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d480a6a80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3584217308 >> 172.21.15.96:0/3584217308 conn(0x7f9d4806bcb0 msgr2=0x7f9d480a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1c0e62640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc06b4a0 0x7fd1bc143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3584217308 shutdown_connections 2024-09-16T06:46:44.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3584217308 wait complete. 2024-09-16T06:46:44.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1c0e62640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc0ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1c0e62640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1bc149d90 0x7fd1bc0ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc0ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 Processor -- start 2024-09-16T06:46:44.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc0ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59424/0 (socket says 172.21.15.96:59424) 2024-09-16T06:46:44.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1bc149d90 0x7fd1bc0ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1bc149d90 0x7fd1bc0ab690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56108/0 (socket says 172.21.15.96:56108) 2024-09-16T06:46:44.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 -- start start 2024-09-16T06:46:44.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 -- 172.21.15.96:0/2974056056 learned_addr learned my addr 172.21.15.96:0/2974056056 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0ac290 con 0x7fd1bc1453b0 2024-09-16T06:46:44.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0aaf50 con 0x7fd1bc06b4a0 2024-09-16T06:46:44.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1ba59c640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc06b4a0 0x7fd1bc143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc0ac7e0 con 0x7fd1bc149d90 2024-09-16T06:46:44.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f7e10d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f780a44c0 0x7f9f7814cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f7e10d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f780a6af0 0x7f9f7806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f7e10d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f777fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f780a44c0 0x7f9f7814cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f777fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f780a44c0 0x7f9f7814cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59436/0 (socket says 172.21.15.96:59436) 2024-09-16T06:46:44.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f780a6af0 0x7f9f7806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 -- 172.21.15.96:0/2974056056 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1bc149d90 msgr2=0x7fd1bc0ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1bc149d90 0x7fd1bc0ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 -- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc06b4a0 msgr2=0x7fd1bc143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc06b4a0 0x7fd1bc143c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac00f610 con 0x7fd1bc1453b0 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56110/0 (socket says 172.21.15.96:56110) 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f76ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f780a6af0 0x7f9f7806fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.96:58388/0 (socket says 172.21.15.96:58388) 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f777fe640 1 -- 172.21.15.96:0/3562447936 learned_addr learned my addr 172.21.15.96:0/3562447936 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7814aff0 con 0x7f9f780a44c0 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8c00a40d0 0x7fa8c0143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8c014bf70 0x7fa8c014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b3fff640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc0ab150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400c530 tx=0x7fd1a400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c0139000 con 0x7fa8c014bf70 2024-09-16T06:46:44.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c013bc30 con 0x7fa8c00a40d0 2024-09-16T06:46:44.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c014ee00 con 0x7fa8c0147340 2024-09-16T06:46:44.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 Processor -- start 2024-09-16T06:46:44.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7814c570 con 0x7f9f780a6af0 2024-09-16T06:46:44.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781493b0 con 0x7f9f781470f0 2024-09-16T06:46:44.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0138530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56112/0 (socket says 172.21.15.96:56112) 2024-09-16T06:46:44.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 -- 172.21.15.96:0/4114172275 learned_addr learned my addr 172.21.15.96:0/4114172275 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8bf7fe640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8c014bf70 0x7fa8c014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b2ffd640 1 -- 172.21.15.96:0/2974056056 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4005220 con 0x7fd1bc1453b0 2024-09-16T06:46:44.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc0aca80 con 0x7fd1bc1453b0 2024-09-16T06:46:44.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fd1b2ffd640 1 -- 172.21.15.96:0/2974056056 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4005380 con 0x7fd1bc1453b0 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8beffd640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8c00a40d0 0x7fa8c0143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 -- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8c00a40d0 msgr2=0x7fa8c0143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8c00a40d0 0x7fa8c0143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 -- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8c014bf70 msgr2=0x7fa8c014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8c014bf70 0x7fa8c014db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 -- 172.21.15.96:0/4114172275 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40094d0 con 0x7fa8c0147340 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8be7fc640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0138530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8b401a120 tx=0x7fa8b401ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8a77fe640 1 -- 172.21.15.96:0/4114172275 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40b3800 con 0x7fa8c0147340 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8a77fe640 1 -- 172.21.15.96:0/4114172275 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b40b3960 con 0x7fa8c0147340 2024-09-16T06:46:44.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8a77fe640 1 -- 172.21.15.96:0/4114172275 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40b3cf0 con 0x7fa8c0147340 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 -- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f780a6af0 msgr2=0x7f9f7806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f780a6af0 0x7f9f7806fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 -- 172.21.15.96:0/3562447936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f780a44c0 msgr2=0x7f9f7814cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f780a44c0 0x7f9f7814cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70009b30 con 0x7f9f781470f0 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f76ffd640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f780a6af0 0x7f9f7806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f77fff640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147f50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9f700ab000 tx=0x7f9f700196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c00a4630 con 0x7fa8c0147340 2024-09-16T06:46:44.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c013c0a0 con 0x7fa8c0147340 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- start start 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d4809a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d480a7b70 0x7f9d480b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d481437a0 0x7f9d48140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4809acf0 con 0x7f9d480a7b70 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480b5df0 con 0x7f9d481437a0 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d4c9b1640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d481d79a0 con 0x7f9d480a4eb0 2024-09-16T06:46:44.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d481437a0 0x7f9d48140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d481437a0 0x7f9d48140630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.96:58410/0 (socket says 172.21.15.96:58410) 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 -- 172.21.15.96:0/3733764310 learned_addr learned my addr 172.21.15.96:0/3733764310 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 -- 172.21.15.96:0/3733764310 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 msgr2=0x7f9d4809a540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d4809a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 -- 172.21.15.96:0/3733764310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d480a7b70 msgr2=0x7f9d480b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d480a7b70 0x7f9d480b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9d46d9d640 1 -- 172.21.15.96:0/3733764310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c009190 con 0x7f9d481437a0 2024-09-16T06:46:44.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f5ffff640 1 -- 172.21.15.96:0/3562447936 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70009510 con 0x7f9f781470f0 2024-09-16T06:46:44.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f5ffff640 1 -- 172.21.15.96:0/3562447936 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f700b8470 con 0x7f9f781470f0 2024-09-16T06:46:44.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f5ffff640 1 -- 172.21.15.96:0/3562447936 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f700b8800 con 0x7f9f781470f0 2024-09-16T06:46:44.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f78070b50 con 0x7f9f781470f0 2024-09-16T06:46:44.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.443+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c0147760 con 0x7fa8c0147340 2024-09-16T06:46:44.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7814b420 con 0x7f9f781470f0 2024-09-16T06:46:44.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9d46d9d640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d481437a0 0x7f9d48140630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9d40007e60 tx=0x7f9d4000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9d36ffd640 1 -- 172.21.15.96:0/3733764310 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40014420 con 0x7f9d481437a0 2024-09-16T06:46:44.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9d36ffd640 1 -- 172.21.15.96:0/3733764310 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d400145a0 con 0x7f9d481437a0 2024-09-16T06:46:44.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9d36ffd640 1 -- 172.21.15.96:0/3733764310 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40014950 con 0x7f9d481437a0 2024-09-16T06:46:44.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8a77fe640 1 -- 172.21.15.96:0/4114172275 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fa8b40b2380 con 0x7fa8c0147340 2024-09-16T06:46:44.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8a77fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d38009420 con 0x7f9d481437a0 2024-09-16T06:46:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d480a8bc0 con 0x7f9d481437a0 2024-09-16T06:46:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d480a5320 con 0x7f9d481437a0 2024-09-16T06:46:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8a77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8a77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8a77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8a77fe640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa8ac097910 0x7fa8ac099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc148c50 con 0x7fd1bc1453b0 2024-09-16T06:46:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 1 -- 172.21.15.96:0/2974056056 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4007270 con 0x7fd1bc1453b0 2024-09-16T06:46:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 1 -- 172.21.15.96:0/2974056056 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fd1a4007490 con 0x7fd1bc1453b0 2024-09-16T06:46:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8a77fe640 1 -- 172.21.15.96:0/4114172275 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fa8b415a770 con 0x7fa8c0147340 2024-09-16T06:46:44.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd19c097840 0x7fd19c099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1ba59c640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd19c097840 0x7fd19c099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a0005050 con 0x7fd1bc1453b0 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8beffd640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa8ac097910 0x7fa8ac099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fd1b2ffd640 1 -- 172.21.15.96:0/2974056056 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fd1a40908e0 con 0x7fd1bc1453b0 2024-09-16T06:46:44.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f78070800 con 0x7f9f781470f0 2024-09-16T06:46:44.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7fa8beffd640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa8ac097910 0x7fa8ac099dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0000f70 tx=0x7fa8b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9f5ffff640 1 -- 172.21.15.96:0/3562447936 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f9f700b8960 con 0x7f9f781470f0 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.447+0000 7f9f5ffff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9f5ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9f5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9f5ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9f5ffff640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9f64097910 0x7f9f64099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9f5ffff640 1 -- 172.21.15.96:0/3562447936 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f9f7015ac40 con 0x7f9f781470f0 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9f777fe640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9f64097910 0x7f9f64099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9f777fe640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9f64097910 0x7f9f64099dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800bb90 tx=0x7f9f68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7fa8a77fe640 1 -- 172.21.15.96:0/4114172275 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8b4127f80 con 0x7fa8c0147340 2024-09-16T06:46:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d36ffd640 1 -- 172.21.15.96:0/3733764310 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f9d40014ab0 con 0x7f9d481437a0 2024-09-16T06:46:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d36ffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d36ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d36ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d36ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d36ffd640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9d280978c0 0x7f9d28099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:44.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d36ffd640 1 -- 172.21.15.96:0/3733764310 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f9d400c15f0 con 0x7f9d481437a0 2024-09-16T06:46:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7f9d4659c640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9d280978c0 0x7f9d28099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.451+0000 7fd1ba59c640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd19c097840 0x7fd19c099d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b3000 tx=0x7fd1ac0ab000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.455+0000 7f9d4659c640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9d280978c0 0x7f9d28099d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d380ad000 tx=0x7f9d380a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:44.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.455+0000 7fd1b2ffd640 1 -- 172.21.15.96:0/2974056056 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd1a408c520 con 0x7fd1bc1453b0 2024-09-16T06:46:44.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.463+0000 7f9f5ffff640 1 -- 172.21.15.96:0/3562447936 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f78070800 con 0x7f9f781470f0 2024-09-16T06:46:44.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.463+0000 7f9d36ffd640 1 -- 172.21.15.96:0/3733764310 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d4008ec60 con 0x7f9d481437a0 2024-09-16T06:46:44.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.607+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd1a00055d0 con 0x7fd1bc1453b0 2024-09-16T06:46:44.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1b2ffd640 1 -- 172.21.15.96:0/2974056056 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1a408fb40 con 0x7fd1bc1453b0 2024-09-16T06:46:44.613 INFO:teuthology.orchestra.run.smithi096.stdout:38654705671 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 10 mgrc shutdown 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd19c097840 msgr2=0x7fd19c099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd19c097840 0x7fd19c099d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b3000 tx=0x7fd1ac0ab000 comp rx=0 tx=0).stop 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1bc1453b0 msgr2=0x7fd1bc0ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc0ab150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400c530 tx=0x7fd1a400c9f0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 shutdown_connections 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd19c097840 0x7fd19c099d00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd1bc1453b0 0x7fd1bc0ab150 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd1bc149d90 0x7fd1bc0ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 --2- 172.21.15.96:0/2974056056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1bc06b4a0 0x7fd1bc143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 >> 172.21.15.96:0/2974056056 conn(0x7fd1bc072d70 msgr2=0x7fd1bc0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 shutdown_connections 2024-09-16T06:46:44.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.611+0000 7fd1c0e62640 1 -- 172.21.15.96:0/2974056056 wait complete. 2024-09-16T06:46:44.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.615+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f78070800 con 0x7f9f781470f0 2024-09-16T06:46:44.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.615+0000 7f9f5ffff640 1 -- 172.21.15.96:0/3562447936 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f78070800 con 0x7f9f781470f0 2024-09-16T06:46:44.620 INFO:teuthology.orchestra.run.smithi096.stdout:38654705670 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 10 mgrc shutdown 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9f64097910 msgr2=0x7f9f64099dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9f64097910 0x7f9f64099dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800bb90 tx=0x7f9f68008040 comp rx=0 tx=0).stop 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 msgr2=0x7f9f78147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147f50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9f700ab000 tx=0x7f9f700196e0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 shutdown_connections 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9f64097910 0x7f9f64099dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9f781470f0 0x7f9f78147f50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f780a6af0 0x7f9f7806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 --2- 172.21.15.96:0/3562447936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f780a44c0 0x7f9f7814cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 >> 172.21.15.96:0/3562447936 conn(0x7f9f7806bcb0 msgr2=0x7f9f7814d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 shutdown_connections 2024-09-16T06:46:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.619+0000 7f9f7e10d640 1 -- 172.21.15.96:0/3562447936 wait complete. 2024-09-16T06:46:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.627+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8c0071890 con 0x7fa8c0147340 2024-09-16T06:46:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.627+0000 7fa8a77fe640 1 -- 172.21.15.96:0/4114172275 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8b412b5a0 con 0x7fa8c0147340 2024-09-16T06:46:44.632 INFO:teuthology.orchestra.run.smithi096.stdout:38654705669 2024-09-16T06:46:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 10 mgrc shutdown 2024-09-16T06:46:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa8ac097910 msgr2=0x7fa8ac099dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa8ac097910 0x7fa8ac099dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0000f70 tx=0x7fa8b0009040 comp rx=0 tx=0).stop 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 msgr2=0x7fa8c0138530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0138530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa8b401a120 tx=0x7fa8b401ad30 comp rx=0 tx=0).stop 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 shutdown_connections 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa8ac097910 0x7fa8ac099dd0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0000f70 tx=0x7fa8b0009040 comp rx=0 tx=0).stop 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8c014bf70 0x7fa8c014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8c0147340 0x7fa8c0138530 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 --2- 172.21.15.96:0/4114172275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8c00a40d0 0x7fa8c0143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 >> 172.21.15.96:0/4114172275 conn(0x7fa8c006bb60 msgr2=0x7fa8c0150290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 shutdown_connections 2024-09-16T06:46:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7fa8c53b1640 1 -- 172.21.15.96:0/4114172275 wait complete. 2024-09-16T06:46:44.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.1 2024-09-16T06:46:44.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d480a3f30 con 0x7f9d481437a0 2024-09-16T06:46:44.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.631+0000 7f9d36ffd640 1 -- 172.21.15.96:0/3733764310 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d40090b90 con 0x7f9d481437a0 2024-09-16T06:46:44.637 INFO:teuthology.orchestra.run.smithi096.stdout:38654705670 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 10 mgrc shutdown 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9d280978c0 msgr2=0x7f9d28099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9d280978c0 0x7f9d28099d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d380ad000 tx=0x7f9d380a6000 comp rx=0 tx=0).stop 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d481437a0 msgr2=0x7f9d48140630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d481437a0 0x7f9d48140630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9d40007e60 tx=0x7f9d4000e4b0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 shutdown_connections 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9d280978c0 0x7f9d28099d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d480a7b70 0x7f9d480b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d481437a0 0x7f9d48140630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 --2- 172.21.15.96:0/3733764310 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9d480a4eb0 0x7f9d4809a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:44.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 >> 172.21.15.96:0/3733764310 conn(0x7f9d4806bcb0 msgr2=0x7f9d4806d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:44.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 shutdown_connections 2024-09-16T06:46:44.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:44.635+0000 7f9d4c9b1640 1 -- 172.21.15.96:0/3733764310 wait complete. 2024-09-16T06:46:44.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.3 2024-09-16T06:46:44.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-09-16T06:46:44.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2024-09-16T06:46:45.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T06:46:45.643 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T06:46:45.654 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T06:46:45.656 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T06:46:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 Processor -- start 2024-09-16T06:46:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 -- start start 2024-09-16T06:46:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8db40a40a0 0x7f8db40a4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db4069ce0 0x7f8db406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8db406e820 0x7f8db406ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db406c900 con 0x7f8db406e820 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db406cb30 con 0x7f8db40a40a0 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8dbb768640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db406cdf0 con 0x7f8db4069ce0 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db4069ce0 0x7f8db406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db4069ce0 0x7f8db406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56126/0 (socket says 172.21.15.96:56126) 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 -- 172.21.15.96:0/2198738184 learned_addr learned my addr 172.21.15.96:0/2198738184 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db9d05640 1 --2- 172.21.15.96:0/2198738184 >> v2:172.21.15.96:3300/0 conn(0x7f8db406e820 0x7f8db406ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db9504640 1 --2- 172.21.15.96:0/2198738184 >> v2:172.21.15.134:3300/0 conn(0x7f8db40a40a0 0x7f8db40a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 -- 172.21.15.96:0/2198738184 >> v2:172.21.15.134:3300/0 conn(0x7f8db40a40a0 msgr2=0x7f8db40a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 --2- 172.21.15.96:0/2198738184 >> v2:172.21.15.134:3300/0 conn(0x7f8db40a40a0 0x7f8db40a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 -- 172.21.15.96:0/2198738184 >> v2:172.21.15.96:3300/0 conn(0x7f8db406e820 msgr2=0x7f8db406ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 --2- 172.21.15.96:0/2198738184 >> v2:172.21.15.96:3300/0 conn(0x7f8db406e820 0x7f8db406ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db8d03640 1 -- 172.21.15.96:0/2198738184 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db40a3e00 con 0x7f8db4069ce0 2024-09-16T06:46:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.763+0000 7f8db9d05640 1 --2- 172.21.15.96:0/2198738184 >> v2:172.21.15.96:3300/0 conn(0x7f8db406e820 0x7f8db406ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:45.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8db8d03640 1 --2- 172.21.15.96:0/2198738184 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db4069ce0 0x7f8db406dc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db40a8cd0 tx=0x7f8da401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b909df390a177c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dabfff640 1 -- 172.21.15.96:0/2198738184 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40ab650 con 0x7f8db4069ce0 2024-09-16T06:46:45.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dabfff640 1 -- 172.21.15.96:0/2198738184 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da40ab7b0 con 0x7f8db4069ce0 2024-09-16T06:46:45.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dabfff640 1 -- 172.21.15.96:0/2198738184 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40abb40 con 0x7f8db4069ce0 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 -- 172.21.15.96:0/2198738184 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db4069ce0 msgr2=0x7f8db406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 --2- 172.21.15.96:0/2198738184 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db4069ce0 0x7f8db406dc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db40a8cd0 tx=0x7f8da401c470 comp rx=0 tx=0).stop 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 -- 172.21.15.96:0/2198738184 shutdown_connections 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 --2- 172.21.15.96:0/2198738184 >> v2:172.21.15.96:3300/0 conn(0x7f8db406e820 0x7f8db406ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 --2- 172.21.15.96:0/2198738184 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db4069ce0 0x7f8db406dc00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 --2- 172.21.15.96:0/2198738184 >> v2:172.21.15.134:3300/0 conn(0x7f8db40a40a0 0x7f8db40a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 -- 172.21.15.96:0/2198738184 >> 172.21.15.96:0/2198738184 conn(0x7f8db406bcb0 msgr2=0x7f8db40a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 -- 172.21.15.96:0/2198738184 shutdown_connections 2024-09-16T06:46:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.767+0000 7f8dbb768640 1 -- 172.21.15.96:0/2198738184 wait complete. 2024-09-16T06:46:45.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 Processor -- start 2024-09-16T06:46:45.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 -- start start 2024-09-16T06:46:45.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8db4069ce0 0x7f8db414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db406e820 0x7f8db40ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db40a40a0 0x7f8db4141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db414aaa0 con 0x7f8db4069ce0 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db40afca0 con 0x7f8db406e820 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db40aff60 con 0x7f8db40a40a0 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9d05640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db40a40a0 0x7f8db4141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9d05640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db40a40a0 0x7f8db4141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56134/0 (socket says 172.21.15.96:56134) 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9d05640 1 -- 172.21.15.96:0/3486629729 learned_addr learned my addr 172.21.15.96:0/3486629729 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9504640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8db4069ce0 0x7f8db414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db8d03640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db406e820 0x7f8db40ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9504640 1 -- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db40a40a0 msgr2=0x7f8db4141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9504640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db40a40a0 0x7f8db4141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9504640 1 -- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db406e820 msgr2=0x7f8db40ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9504640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db406e820 0x7f8db40ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9504640 1 -- 172.21.15.96:0/3486629729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac009a70 con 0x7f8db4069ce0 2024-09-16T06:46:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8db9504640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8db4069ce0 0x7f8db414a0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8db000d5f0 tx=0x7f8db000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8da9ffb640 1 -- 172.21.15.96:0/3486629729 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00125f0 con 0x7f8db4069ce0 2024-09-16T06:46:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8da9ffb640 1 -- 172.21.15.96:0/3486629729 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0012750 con 0x7f8db4069ce0 2024-09-16T06:46:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.771+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da40094d0 con 0x7f8db4069ce0 2024-09-16T06:46:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 1 -- 172.21.15.96:0/3486629729 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0012ae0 con 0x7f8db4069ce0 2024-09-16T06:46:45.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db40af400 con 0x7f8db4069ce0 2024-09-16T06:46:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 1 -- 172.21.15.96:0/3486629729 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f8db0012c40 con 0x7f8db4069ce0 2024-09-16T06:46:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db406ec90 con 0x7f8db4069ce0 2024-09-16T06:46:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8d98097840 0x7f8d98099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8da9ffb640 1 -- 172.21.15.96:0/3486629729 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f8db00c00d0 con 0x7f8db4069ce0 2024-09-16T06:46:45.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.775+0000 7f8db8d03640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8d98097840 0x7f8d98099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.779+0000 7f8db8d03640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8d98097840 0x7f8d98099d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8da40af000 tx=0x7f8da40b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.783+0000 7f8da9ffb640 1 -- 172.21.15.96:0/3486629729 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8db008d7e0 con 0x7f8db4069ce0 2024-09-16T06:46:45.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4abed4640 1 Processor -- start 2024-09-16T06:46:45.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095fb6f640 1 Processor -- start 2024-09-16T06:46:45.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4abed4640 1 -- start start 2024-09-16T06:46:45.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095fb6f640 1 -- start start 2024-09-16T06:46:45.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4abed4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe4a406df40 0x7fe4a40a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095fb6f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f09580a7dc0 0x7f09580a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095fb6f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580a81a0 con 0x7f09580a89b0 2024-09-16T06:46:45.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4abed4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a406e320 con 0x7fe4a406a290 2024-09-16T06:46:45.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4abed4640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a41443b0 con 0x7fe4a40a3b70 2024-09-16T06:46:45.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4abed4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40a7280 con 0x7fe4a406df40 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a9c70640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe4a406df40 0x7fe4a40a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a9c70640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe4a406df40 0x7fe4a40a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59460/0 (socket says 172.21.15.96:59460) 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a9c70640 1 -- 172.21.15.96:0/2433014052 learned_addr learned my addr 172.21.15.96:0/2433014052 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095fb6f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580a5210 con 0x7f09581368a0 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095d10a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f09580a89b0 0x7f09580a4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52452/0 (socket says 172.21.15.96:52452) 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095d10a640 1 -- 172.21.15.96:0/1072786245 learned_addr learned my addr 172.21.15.96:0/1072786245 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095d90b640 1 --2- 172.21.15.96:0/1072786245 >> v2:172.21.15.96:3300/0 conn(0x7f09580a7dc0 0x7f09580a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095fb6f640 1 -- 172.21.15.96:0/1072786245 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580a8550 con 0x7f09580a7dc0 2024-09-16T06:46:45.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a9c70640 1 -- 172.21.15.96:0/2433014052 >> v1:172.21.15.134:6789/0 conn(0x7fe4a40a3b70 legacy=0x7fe4a414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a9c70640 1 -- 172.21.15.96:0/2433014052 >> v1:172.21.15.96:6789/0 conn(0x7fe4a406a290 legacy=0x7fe4a4142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a9c70640 1 -- 172.21.15.96:0/2433014052 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40a6fc0 con 0x7fe4a406df40 2024-09-16T06:46:45.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a8c6e640 1 -- 172.21.15.96:0/2433014052 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072092541 0 0) 0x7fe494001120 con 0x7fe4a406a290 2024-09-16T06:46:45.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095c909640 1 -- 172.21.15.96:0/1072786245 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977380184 0 0) 0x7f09580a81a0 con 0x7f09580a89b0 2024-09-16T06:46:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095c909640 1 -- 172.21.15.96:0/1072786245 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0944003530 con 0x7f09580a89b0 2024-09-16T06:46:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095d90b640 1 -- 172.21.15.96:0/1072786245 >> v1:172.21.15.134:6789/0 conn(0x7f09581368a0 legacy=0x7f095814aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095d90b640 1 -- 172.21.15.96:0/1072786245 >> v1:172.21.15.96:6789/0 conn(0x7f09580a89b0 legacy=0x7f09580a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095d90b640 1 -- 172.21.15.96:0/1072786245 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580a4590 con 0x7f09580a7dc0 2024-09-16T06:46:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a9c70640 1 --2- 172.21.15.96:0/2433014052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406df40 0x7fe4a40a6a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009870 tx=0x7fe4a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955f41cf6c38993e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a8c6e640 1 -- 172.21.15.96:0/2433014052 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00ac640 con 0x7fe4a406df40 2024-09-16T06:46:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a8c6e640 1 -- 172.21.15.96:0/2433014052 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a00ac7a0 con 0x7fe4a406df40 2024-09-16T06:46:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7fe4a8c6e640 1 -- 172.21.15.96:0/2433014052 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00acb30 con 0x7fe4a406df40 2024-09-16T06:46:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.799+0000 7f095d90b640 1 --2- 172.21.15.96:0/1072786245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f09580a6a80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09540097c0 tx=0x7f095401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b96894501ea1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095c909640 1 -- 172.21.15.96:0/1072786245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09540ab5f0 con 0x7f09580a7dc0 2024-09-16T06:46:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095c909640 1 -- 172.21.15.96:0/1072786245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09540ab750 con 0x7f09580a7dc0 2024-09-16T06:46:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095c909640 1 -- 172.21.15.96:0/1072786245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09540abac0 con 0x7f09580a7dc0 2024-09-16T06:46:45.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- 172.21.15.96:0/2433014052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406df40 msgr2=0x7fe4a40a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2433014052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406df40 0x7fe4a40a6a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009870 tx=0x7fe4a001c480 comp rx=0 tx=0).stop 2024-09-16T06:46:45.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- 172.21.15.96:0/2433014052 shutdown_connections 2024-09-16T06:46:45.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2433014052 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406df40 0x7fe4a40a6a80 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009870 tx=0x7fe4a001c480 comp rx=0 tx=0).stop 2024-09-16T06:46:45.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- 172.21.15.96:0/2433014052 >> 172.21.15.96:0/2433014052 conn(0x7fe4a406bcb0 msgr2=0x7fe4a40a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- 172.21.15.96:0/2433014052 shutdown_connections 2024-09-16T06:46:45.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- 172.21.15.96:0/2433014052 wait complete. 2024-09-16T06:46:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 -- 172.21.15.96:0/1072786245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 msgr2=0x7f09580a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 --2- 172.21.15.96:0/1072786245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f09580a6a80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09540097c0 tx=0x7f095401c3f0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 -- 172.21.15.96:0/1072786245 shutdown_connections 2024-09-16T06:46:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 --2- 172.21.15.96:0/1072786245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f09580a6a80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 -- 172.21.15.96:0/1072786245 >> 172.21.15.96:0/1072786245 conn(0x7f095806bcb0 msgr2=0x7f09580a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 -- 172.21.15.96:0/1072786245 shutdown_connections 2024-09-16T06:46:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 -- 172.21.15.96:0/1072786245 wait complete. 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 Processor -- start 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- start start 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406a290 0x7fe4a40b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4a40a3b70 0x7fe4a413bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe4a413b3d0 0x7fe4a406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a413a670 con 0x7fe4a406a290 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a413c2b0 con 0x7fe4a40a3b70 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a413cee0 con 0x7fe4a413b3d0 2024-09-16T06:46:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 Processor -- start 2024-09-16T06:46:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe4a413b3d0 0x7fe4a406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4a9c70640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406a290 0x7fe4a40b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe4a413b3d0 0x7fe4a406f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56148/0 (socket says 172.21.15.96:56148) 2024-09-16T06:46:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4a9c70640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406a290 0x7fe4a40b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59486/0 (socket says 172.21.15.96:59486) 2024-09-16T06:46:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 -- 172.21.15.96:0/2957656372 learned_addr learned my addr 172.21.15.96:0/2957656372 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 -- start start 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4a946f640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4a40a3b70 0x7fe4a413bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 -- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4a40a3b70 msgr2=0x7fe4a413bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4a40a3b70 0x7fe4a413bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 -- 172.21.15.96:0/2957656372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406a290 msgr2=0x7fe4a40b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406a290 0x7fe4a40b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 -- 172.21.15.96:0/2957656372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00094d0 con 0x7fe4a413b3d0 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4aa471640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe4a413b3d0 0x7fe4a406f870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00c790 tx=0x7fe49c00cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe49a7fc640 1 -- 172.21.15.96:0/2957656372 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c003b80 con 0x7fe4a413b3d0 2024-09-16T06:46:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe49a7fc640 1 -- 172.21.15.96:0/2957656372 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c003ce0 con 0x7fe4a413b3d0 2024-09-16T06:46:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe49a7fc640 1 -- 172.21.15.96:0/2957656372 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00aa30 con 0x7fe4a413b3d0 2024-09-16T06:46:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a413d1a0 con 0x7fe4a413b3d0 2024-09-16T06:46:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a413c560 con 0x7fe4a413b3d0 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.803+0000 7f095fb6f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f095814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09580a89b0 0x7f0958140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f095814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f095814b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59490/0 (socket says 172.21.15.96:59490) 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 -- 172.21.15.96:0/3267607350 learned_addr learned my addr 172.21.15.96:0/3267607350 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f09581368a0 0x7f0958140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580a27e0 con 0x7f09580a7dc0 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d10a640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09580a89b0 0x7f0958140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581484c0 con 0x7f09580a89b0 2024-09-16T06:46:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0958147a20 con 0x7f09581368a0 2024-09-16T06:46:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a40a6a80 con 0x7fe4a413b3d0 2024-09-16T06:46:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095e10c640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f09581368a0 0x7f0958140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 -- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f09581368a0 msgr2=0x7f0958140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f09581368a0 0x7f0958140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 -- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09580a89b0 msgr2=0x7f0958140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09580a89b0 0x7f0958140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954009420 con 0x7f09580a7dc0 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d10a640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09580a89b0 0x7f0958140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095d90b640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f095814b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09540ad040 tx=0x7f0954019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f094e7fc640 1 -- 172.21.15.96:0/3267607350 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09540abac0 con 0x7f09580a7dc0 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f094e7fc640 1 -- 172.21.15.96:0/3267607350 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09540abc20 con 0x7f09580a7dc0 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f094e7fc640 1 -- 172.21.15.96:0/3267607350 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954003620 con 0x7f09580a7dc0 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09581486f0 con 0x7f09580a7dc0 2024-09-16T06:46:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0958147e20 con 0x7f09580a7dc0 2024-09-16T06:46:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe49a7fc640 1 -- 172.21.15.96:0/2957656372 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fe49c00ab90 con 0x7fe4a413b3d0 2024-09-16T06:46:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe49a7fc640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe49a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe49a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe49a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe49a7fc640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe4880978c0 0x7fe488099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fb6423ba640 1 Processor -- start 2024-09-16T06:46:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe49a7fc640 1 -- 172.21.15.96:0/2957656372 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fe49c0bf9f0 con 0x7fe4a413b3d0 2024-09-16T06:46:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7fe4a9c70640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe4880978c0 0x7fe488099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.807+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09580a2500 con 0x7f09580a7dc0 2024-09-16T06:46:45.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb6423ba640 1 -- start start 2024-09-16T06:46:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fe4a9c70640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe4880978c0 0x7fe488099d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00ae000 tx=0x7fe4a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f094e7fc640 1 -- 172.21.15.96:0/3267607350 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f0954003990 con 0x7f09580a7dc0 2024-09-16T06:46:45.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f094e7fc640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:45.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb6423ba640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb63c0a6180 0x7fb63c14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb6423ba640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c143ab0 con 0x7fb63c0a4190 2024-09-16T06:46:45.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb6423ba640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c06b020 con 0x7fb63c0a3db0 2024-09-16T06:46:45.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb6423ba640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0a5410 con 0x7fb63c0a6180 2024-09-16T06:46:45.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f094e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:45.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f094e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f094e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f094e7fc640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f093c097840 0x7f093c099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63bfff640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb63c0a3db0 0x7fb63c06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.96:52910/0 (socket says 172.21.15.96:52910) 2024-09-16T06:46:45.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63bfff640 1 -- 172.21.15.96:0/34606353 learned_addr learned my addr 172.21.15.96:0/34606353 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:45.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f095d10a640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f093c097840 0x7f093c099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448079553 0 0) 0x7fb63c06b020 con 0x7fb63c0a3db0 2024-09-16T06:46:45.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb624003530 con 0x7fb63c0a3db0 2024-09-16T06:46:45.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2769444608 0 0) 0x7fb624003530 con 0x7fb63c0a3db0 2024-09-16T06:46:45.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 >> v2:172.21.15.96:3300/0 conn(0x7fb63c0a6180 msgr2=0x7fb63c14bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:45.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 --2- 172.21.15.96:0/34606353 >> v2:172.21.15.96:3300/0 conn(0x7fb63c0a6180 0x7fb63c14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 >> v1:172.21.15.96:6789/0 conn(0x7fb63c0a4190 legacy=0x7fb63c144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c06dd30 con 0x7fb63c0a3db0 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 633242010 0 0) 0x7fb634001a00 con 0x7fb63c0a3db0 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 >> v1:172.21.15.134:6789/0 conn(0x7fb63c0a3db0 legacy=0x7fb63c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb624003980 0x7fb624003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6240047d0 0x7fb624004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb62400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0a5410 con 0x7fb6240047d0 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62400c1b0 con 0x7fb6240052b0 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62400c370 con 0x7fb624003980 2024-09-16T06:46:45.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f095d10a640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f093c097840 0x7f093c099d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f095806fae0 tx=0x7f0948009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb640957640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb62400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb640957640 1 -- 172.21.15.96:0/34606353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb624003980 msgr2=0x7fb624003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb640957640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb624003980 0x7fb624003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb640957640 1 -- 172.21.15.96:0/34606353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6240047d0 msgr2=0x7fb624004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb640957640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb6240047d0 0x7fb624004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fb640957640 1 -- 172.21.15.96:0/34606353 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624003530 con 0x7fb6240052b0 2024-09-16T06:46:45.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7f094e7fc640 1 -- 172.21.15.96:0/3267607350 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f09540a8050 con 0x7f09580a7dc0 2024-09-16T06:46:45.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.811+0000 7fe49a7fc640 1 -- 172.21.15.96:0/2957656372 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe49c08d0f0 con 0x7fe4a413b3d0 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb640957640 1 -- 172.21.15.96:0/34606353 reap_dead start 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb640957640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb62400b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009860 tx=0x7fb62c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c454e4703184a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c004220 con 0x7fb6240052b0 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c0a7050 con 0x7fb6240052b0 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb63affd640 1 -- 172.21.15.96:0/34606353 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c003620 con 0x7fb6240052b0 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 -- 172.21.15.96:0/34606353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 msgr2=0x7fb62400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb62400b990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009860 tx=0x7fb62c01c360 comp rx=0 tx=0).stop 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 -- 172.21.15.96:0/34606353 shutdown_connections 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 --2- 172.21.15.96:0/34606353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb62400b990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 -- 172.21.15.96:0/34606353 >> 172.21.15.96:0/34606353 conn(0x7fb63c06b8a0 msgr2=0x7fb63c0a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 -- 172.21.15.96:0/34606353 shutdown_connections 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 -- 172.21.15.96:0/34606353 wait complete. 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 Processor -- start 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.815+0000 7fb6423ba640 1 -- start start 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb63c09d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c13bca0 0x7fb63c13c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63c09bcc0 0x7fb63c09c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c09dcd0 con 0x7fb63c13bca0 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c09a6b0 con 0x7fb6240052b0 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c098a70 con 0x7fb63c09bcc0 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c13bca0 0x7fb63c13c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c13bca0 0x7fb63c13c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59516/0 (socket says 172.21.15.96:59516) 2024-09-16T06:46:45.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 -- 172.21.15.96:0/2314938536 learned_addr learned my addr 172.21.15.96:0/2314938536 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:45.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7f094e7fc640 1 -- 172.21.15.96:0/3267607350 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09541279e0 con 0x7f09580a7dc0 2024-09-16T06:46:45.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb640957640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63c09bcc0 0x7fb63c09c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63bfff640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb63c09d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 -- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63c09bcc0 msgr2=0x7fb63c09c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63c09bcc0 0x7fb63c09c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 -- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 msgr2=0x7fb63c09d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb63c09d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 -- 172.21.15.96:0/2314938536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c09cc90 con 0x7fb63c13bca0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63bfff640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb63c09d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb63b7fe640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c13bca0 0x7fb63c13c0e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c410 tx=0x7fb63000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb638ff9640 1 -- 172.21.15.96:0/2314938536 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630003600 con 0x7fb63c13bca0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb638ff9640 1 -- 172.21.15.96:0/2314938536 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630003760 con 0x7fb63c13bca0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c13c930 con 0x7fb63c13bca0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb638ff9640 1 -- 172.21.15.96:0/2314938536 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630003b10 con 0x7fb63c13bca0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c13c620 con 0x7fb63c13bca0 2024-09-16T06:46:45.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.819+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c09de10 con 0x7fb63c13bca0 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb638ff9640 1 -- 172.21.15.96:0/2314938536 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fb630003c70 con 0x7fb63c13bca0 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb638ff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb638ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb638ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb638ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb638ff9640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb628097870 0x7fb628099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb638ff9640 1 -- 172.21.15.96:0/2314938536 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fb6300bf540 con 0x7fb63c13bca0 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb63bfff640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb628097870 0x7fb628099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.823+0000 7fb63bfff640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb628097870 0x7fb628099d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb634001bb0 tx=0x7fb634001920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:45.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.831+0000 7fb638ff9640 1 -- 172.21.15.96:0/2314938536 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb63008cc50 con 0x7fb63c13bca0 2024-09-16T06:46:45.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.955+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8db40a7f00 con 0x7f8db4069ce0 2024-09-16T06:46:45.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.955+0000 7f8da9ffb640 1 -- 172.21.15.96:0/3486629729 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8db008f710 con 0x7f8db4069ce0 2024-09-16T06:46:45.961 INFO:teuthology.orchestra.run.smithi096.stdout:38654705672 2024-09-16T06:46:45.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 10 mgrc shutdown 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8d98097840 msgr2=0x7f8d98099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8d98097840 0x7f8d98099d00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8da40af000 tx=0x7f8da40b6040 comp rx=0 tx=0).stop 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8db4069ce0 msgr2=0x7f8db414a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8db4069ce0 0x7f8db414a0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8db000d5f0 tx=0x7f8db000dab0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 shutdown_connections 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f8d98097840 0x7f8d98099d00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8db40a40a0 0x7f8db4141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8db406e820 0x7f8db40ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 --2- 172.21.15.96:0/3486629729 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8db4069ce0 0x7f8db414a0a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 >> 172.21.15.96:0/3486629729 conn(0x7f8db406bcb0 msgr2=0x7f8db40b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 shutdown_connections 2024-09-16T06:46:45.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.959+0000 7f8dbb768640 1 -- 172.21.15.96:0/3486629729 wait complete. 2024-09-16T06:46:45.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.971+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09580a2500 con 0x7f09580a7dc0 2024-09-16T06:46:45.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.971+0000 7f094e7fc640 1 -- 172.21.15.96:0/3267607350 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09580a2500 con 0x7f09580a7dc0 2024-09-16T06:46:45.976 INFO:teuthology.orchestra.run.smithi096.stdout:38654705670 2024-09-16T06:46:45.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 10 mgrc shutdown 2024-09-16T06:46:45.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f093c097840 msgr2=0x7f093c099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f093c097840 0x7f093c099d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f095806fae0 tx=0x7f0948009040 comp rx=0 tx=0).stop 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 msgr2=0x7f095814b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f095814b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09540ad040 tx=0x7f0954019190 comp rx=0 tx=0).stop 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 shutdown_connections 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f093c097840 0x7f093c099d00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f09581368a0 0x7f0958140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09580a89b0 0x7f0958140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 --2- 172.21.15.96:0/3267607350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09580a7dc0 0x7f095814b0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 >> 172.21.15.96:0/3267607350 conn(0x7f095806bcb0 msgr2=0x7f095806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 shutdown_connections 2024-09-16T06:46:45.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.975+0000 7f095fb6f640 1 -- 172.21.15.96:0/3267607350 wait complete. 2024-09-16T06:46:45.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.1 2024-09-16T06:46:45.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.979+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4a4071850 con 0x7fe4a413b3d0 2024-09-16T06:46:45.983 DEBUG:teuthology.parallel:result is None 2024-09-16T06:46:45.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.979+0000 7fe49a7fc640 1 -- 172.21.15.96:0/2957656372 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe49c090710 con 0x7fe4a413b3d0 2024-09-16T06:46:45.984 INFO:teuthology.orchestra.run.smithi096.stdout:38654705671 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 10 mgrc shutdown 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe4880978c0 msgr2=0x7fe488099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe4880978c0 0x7fe488099d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00ae000 tx=0x7fe4a0008040 comp rx=0 tx=0).stop 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe4a413b3d0 msgr2=0x7fe4a406f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe4a413b3d0 0x7fe4a406f870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00c790 tx=0x7fe49c00cc50 comp rx=0 tx=0).stop 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 shutdown_connections 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fe4880978c0 0x7fe488099d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe4a413b3d0 0x7fe4a406f870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4a40a3b70 0x7fe4a413bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 --2- 172.21.15.96:0/2957656372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4a406a290 0x7fe4a40b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 >> 172.21.15.96:0/2957656372 conn(0x7fe4a406bcb0 msgr2=0x7fe4a40b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 shutdown_connections 2024-09-16T06:46:45.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.983+0000 7fe4abed4640 1 -- 172.21.15.96:0/2957656372 wait complete. 2024-09-16T06:46:45.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb63c09de10 con 0x7fb63c13bca0 2024-09-16T06:46:45.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb638ff9640 1 -- 172.21.15.96:0/2314938536 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb63c09de10 con 0x7fb63c13bca0 2024-09-16T06:46:45.990 INFO:teuthology.orchestra.run.smithi096.stdout:38654705671 2024-09-16T06:46:45.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 10 mgrc shutdown 2024-09-16T06:46:45.992 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb628097870 msgr2=0x7fb628099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb628097870 0x7fb628099d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb634001bb0 tx=0x7fb634001920 comp rx=0 tx=0).stop 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c13bca0 msgr2=0x7fb63c13c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c13bca0 0x7fb63c13c0e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c410 tx=0x7fb63000c8d0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 shutdown_connections 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb628097870 0x7fb628099d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63c13bca0 0x7fb63c13c0e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63c09bcc0 0x7fb63c09c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 --2- 172.21.15.96:0/2314938536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6240052b0 0x7fb63c09d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.987+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 >> 172.21.15.96:0/2314938536 conn(0x7fb63c06b8a0 msgr2=0x7fb63c0a3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.991+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 shutdown_connections 2024-09-16T06:46:45.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:45.991+0000 7fb6423ba640 1 -- 172.21.15.96:0/2314938536 wait complete. 2024-09-16T06:46:45.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-16T06:46:45.996 DEBUG:teuthology.parallel:result is None 2024-09-16T06:46:46.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-09-16T06:46:46.004 DEBUG:teuthology.parallel:result is None 2024-09-16T06:46:46.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-16T06:46:46.009 DEBUG:teuthology.parallel:result is None 2024-09-16T06:46:46.009 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T06:46:46.009 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T06:46:46.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.147+0000 7fbbbf027640 1 Processor -- start 2024-09-16T06:46:46.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.147+0000 7fbbbf027640 1 -- start start 2024-09-16T06:46:46.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbbb80a9310 0x7fbbb8147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80ab660 0x7fbbb814de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb80a96f0 con 0x7fbbb80abe20 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80aa380 con 0x7fbbb80a9310 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8139ee0 con 0x7fbbb80ab660 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80ab660 0x7fbbb814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80ab660 0x7fbbb814de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56180/0 (socket says 172.21.15.96:56180) 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/2052271254 learned_addr learned my addr 172.21.15.96:0/2052271254 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbcdc3640 1 --2- 172.21.15.96:0/2052271254 >> v2:172.21.15.96:3300/0 conn(0x7fbbb80a9310 0x7fbbb8147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/2052271254 >> v2:172.21.15.96:3300/0 conn(0x7fbbb80a9310 msgr2=0x7fbbb8147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 --2- 172.21.15.96:0/2052271254 >> v2:172.21.15.96:3300/0 conn(0x7fbbb80a9310 0x7fbbb8147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/2052271254 >> v1:172.21.15.134:6789/0 conn(0x7fbbb80abe20 legacy=0x7fbbb80aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/2052271254 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8146b10 con 0x7fbbb80ab660 2024-09-16T06:46:46.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbcdc3640 1 --2- 172.21.15.96:0/2052271254 >> v2:172.21.15.96:3300/0 conn(0x7fbbb80a9310 0x7fbbb8147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:46.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbd5c4640 1 --2- 172.21.15.96:0/2052271254 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80ab660 0x7fbbb814de40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009e50 tx=0x7fbbb001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b17ba45d92dc1ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbb77fe640 1 -- 172.21.15.96:0/2052271254 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00a5640 con 0x7fbbb80ab660 2024-09-16T06:46:46.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbb77fe640 1 -- 172.21.15.96:0/2052271254 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb00a57a0 con 0x7fbbb80ab660 2024-09-16T06:46:46.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbb77fe640 1 -- 172.21.15.96:0/2052271254 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00a5b30 con 0x7fbbb80ab660 2024-09-16T06:46:46.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- 172.21.15.96:0/2052271254 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80ab660 msgr2=0x7fbbb814de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 --2- 172.21.15.96:0/2052271254 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80ab660 0x7fbbb814de40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009e50 tx=0x7fbbb001c8b0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- 172.21.15.96:0/2052271254 shutdown_connections 2024-09-16T06:46:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 --2- 172.21.15.96:0/2052271254 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80ab660 0x7fbbb814de40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 --2- 172.21.15.96:0/2052271254 >> v2:172.21.15.96:3300/0 conn(0x7fbbb80a9310 0x7fbbb8147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- 172.21.15.96:0/2052271254 >> 172.21.15.96:0/2052271254 conn(0x7fbbb806b4a0 msgr2=0x7fbbb80a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- 172.21.15.96:0/2052271254 shutdown_connections 2024-09-16T06:46:46.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.151+0000 7fbbbf027640 1 -- 172.21.15.96:0/2052271254 wait complete. 2024-09-16T06:46:46.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 Processor -- start 2024-09-16T06:46:46.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 -- start start 2024-09-16T06:46:46.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb80a9310 0x7fbbb8070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80abe20 0x7fbbb8149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb8149bd0 0x7fbbb81383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8148a00 con 0x7fbbb8149bd0 2024-09-16T06:46:46.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8070ee0 con 0x7fbbb80a9310 2024-09-16T06:46:46.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8070c20 con 0x7fbbb80abe20 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbb7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80abe20 0x7fbbb8149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb8149bd0 0x7fbbb81383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb8149bd0 0x7fbbb81383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59522/0 (socket says 172.21.15.96:59522) 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/1811314212 learned_addr learned my addr 172.21.15.96:0/1811314212 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbb7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80abe20 0x7fbbb8149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56182/0 (socket says 172.21.15.96:56182) 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/1811314212 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80abe20 msgr2=0x7fbbb8149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80abe20 0x7fbbb8149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb80a9310 msgr2=0x7fbbb8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb80a9310 0x7fbbb8070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 -- 172.21.15.96:0/1811314212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba8009420 con 0x7fbbb8149bd0 2024-09-16T06:46:46.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbd5c4640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb8149bd0 0x7fbbb81383a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbbb001af60 tx=0x7fbbb0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbb57fa640 1 -- 172.21.15.96:0/1811314212 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00a5640 con 0x7fbbb8149bd0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbb57fa640 1 -- 172.21.15.96:0/1811314212 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0009510 con 0x7fbbb8149bd0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb0009b30 con 0x7fbbb8149bd0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbb57fa640 1 -- 172.21.15.96:0/1811314212 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0007000 con 0x7fbbb8149bd0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb8148c50 con 0x7fbbb8149bd0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.155+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb8147320 con 0x7fbbb8149bd0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbb57fa640 1 -- 172.21.15.96:0/1811314212 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fbbb00b88c0 con 0x7fbbb8149bd0 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbb57fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbb57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbb57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbb57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:46.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbb57fa640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb98097840 0x7fbb98099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbb57fa640 1 -- 172.21.15.96:0/1811314212 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fbbb015b530 con 0x7fbbb8149bd0 2024-09-16T06:46:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbbcdc3640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb98097840 0x7fbb98099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.159+0000 7fbbbcdc3640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb98097840 0x7fbb98099d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006e90 tx=0x7fbba8006de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.163+0000 7fbbb57fa640 1 -- 172.21.15.96:0/1811314212 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbbb0128cb0 con 0x7fbbb8149bd0 2024-09-16T06:46:46.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.303+0000 7fbbbf027640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-09-16T06:46:46.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.303+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 --> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbb80a69b0 con 0x7fbb98097840 2024-09-16T06:46:46.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.323+0000 7fbbb57fa640 1 -- 172.21.15.96:0/1811314212 <== mgr.4105 v2:172.21.15.134:6824/468510839 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271571 (secure 0 0 0) 0x7fbbb80a69b0 con 0x7fbb98097840 2024-09-16T06:46:46.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.323+0000 7fbbb57fa640 20 mgrc handle_command_reply tid 0 r 0 2024-09-16T06:46:46.330 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:46.331 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-09-16T06:46:46.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 10 mgrc shutdown 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb98097840 msgr2=0x7fbb98099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb98097840 0x7fbb98099d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbba8006e90 tx=0x7fbba8006de0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb8149bd0 msgr2=0x7fbbb81383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb8149bd0 0x7fbbb81383a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbbb001af60 tx=0x7fbbb0019650 comp rx=0 tx=0).stop 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 shutdown_connections 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fbb98097840 0x7fbb98099d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbb8149bd0 0x7fbbb81383a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbb80abe20 0x7fbbb8149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 --2- 172.21.15.96:0/1811314212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbb80a9310 0x7fbbb8070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 >> 172.21.15.96:0/1811314212 conn(0x7fbbb806b4a0 msgr2=0x7fbbb8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 shutdown_connections 2024-09-16T06:46:46.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.327+0000 7fbbbf027640 1 -- 172.21.15.96:0/1811314212 wait complete. 2024-09-16T06:46:46.346 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-16T06:46:44.528957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592749,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109004,"kb_used_data":904,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377378356,"statfs":{"total":386547056640,"available":386435436544,"internally_reserved":0,"allocated":925696,"data_stored":1444894,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":6373,"internal_metadata":110618395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001938"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380908+0000","last_change":"2024-09-16T06:46:39.197129+0000","last_active":"2024-09-16T06:46:39.380908+0000","last_peered":"2024-09-16T06:46:39.380908+0000","last_clean":"2024-09-16T06:46:39.380908+0000","last_became_active":"2024-09-16T06:46:39.196207+0000","last_became_peered":"2024-09-16T06:46:39.196207+0000","last_unstale":"2024-09-16T06:46:39.380908+0000","last_undegraded":"2024-09-16T06:46:39.380908+0000","last_fullsized":"2024-09-16T06:46:39.380908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:46.982408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374531+0000","last_change":"2024-09-16T06:46:39.181387+0000","last_active":"2024-09-16T06:46:39.374531+0000","last_peered":"2024-09-16T06:46:39.374531+0000","last_clean":"2024-09-16T06:46:39.374531+0000","last_became_active":"2024-09-16T06:46:39.181108+0000","last_became_peered":"2024-09-16T06:46:39.181108+0000","last_unstale":"2024-09-16T06:46:39.374531+0000","last_undegraded":"2024-09-16T06:46:39.374531+0000","last_fullsized":"2024-09-16T06:46:39.374531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:32:04.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374320+0000","last_change":"2024-09-16T06:46:39.183249+0000","last_active":"2024-09-16T06:46:39.374320+0000","last_peered":"2024-09-16T06:46:39.374320+0000","last_clean":"2024-09-16T06:46:39.374320+0000","last_became_active":"2024-09-16T06:46:39.181011+0000","last_became_peered":"2024-09-16T06:46:39.181011+0000","last_unstale":"2024-09-16T06:46:39.374320+0000","last_undegraded":"2024-09-16T06:46:39.374320+0000","last_fullsized":"2024-09-16T06:46:39.374320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:31.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574231+0000","last_change":"2024-09-16T06:46:39.200186+0000","last_active":"2024-09-16T06:46:39.574231+0000","last_peered":"2024-09-16T06:46:39.574231+0000","last_clean":"2024-09-16T06:46:39.574231+0000","last_became_active":"2024-09-16T06:46:39.199448+0000","last_became_peered":"2024-09-16T06:46:39.199448+0000","last_unstale":"2024-09-16T06:46:39.574231+0000","last_undegraded":"2024-09-16T06:46:39.574231+0000","last_fullsized":"2024-09-16T06:46:39.574231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380648+0000","last_change":"2024-09-16T06:46:39.178172+0000","last_active":"2024-09-16T06:46:39.380648+0000","last_peered":"2024-09-16T06:46:39.380648+0000","last_clean":"2024-09-16T06:46:39.380648+0000","last_became_active":"2024-09-16T06:46:39.177922+0000","last_became_peered":"2024-09-16T06:46:39.177922+0000","last_unstale":"2024-09-16T06:46:39.380648+0000","last_undegraded":"2024-09-16T06:46:39.380648+0000","last_fullsized":"2024-09-16T06:46:39.380648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379793+0000","last_change":"2024-09-16T06:46:39.174720+0000","last_active":"2024-09-16T06:46:39.379793+0000","last_peered":"2024-09-16T06:46:39.379793+0000","last_clean":"2024-09-16T06:46:39.379793+0000","last_became_active":"2024-09-16T06:46:39.173704+0000","last_became_peered":"2024-09-16T06:46:39.173704+0000","last_unstale":"2024-09-16T06:46:39.379793+0000","last_undegraded":"2024-09-16T06:46:39.379793+0000","last_fullsized":"2024-09-16T06:46:39.379793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:28:34.417850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379306+0000","last_change":"2024-09-16T06:46:39.190614+0000","last_active":"2024-09-16T06:46:39.379306+0000","last_peered":"2024-09-16T06:46:39.379306+0000","last_clean":"2024-09-16T06:46:39.379306+0000","last_became_active":"2024-09-16T06:46:39.179458+0000","last_became_peered":"2024-09-16T06:46:39.179458+0000","last_unstale":"2024-09-16T06:46:39.379306+0000","last_undegraded":"2024-09-16T06:46:39.379306+0000","last_fullsized":"2024-09-16T06:46:39.379306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:26:50.541794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373056+0000","last_change":"2024-09-16T06:46:39.185393+0000","last_active":"2024-09-16T06:46:39.373056+0000","last_peered":"2024-09-16T06:46:39.373056+0000","last_clean":"2024-09-16T06:46:39.373056+0000","last_became_active":"2024-09-16T06:46:39.185079+0000","last_became_peered":"2024-09-16T06:46:39.185079+0000","last_unstale":"2024-09-16T06:46:39.373056+0000","last_undegraded":"2024-09-16T06:46:39.373056+0000","last_fullsized":"2024-09-16T06:46:39.373056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380930+0000","last_change":"2024-09-16T06:46:39.197247+0000","last_active":"2024-09-16T06:46:39.380930+0000","last_peered":"2024-09-16T06:46:39.380930+0000","last_clean":"2024-09-16T06:46:39.380930+0000","last_became_active":"2024-09-16T06:46:39.196174+0000","last_became_peered":"2024-09-16T06:46:39.196174+0000","last_unstale":"2024-09-16T06:46:39.380930+0000","last_undegraded":"2024-09-16T06:46:39.380930+0000","last_fullsized":"2024-09-16T06:46:39.380930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:07.159072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574113+0000","last_change":"2024-09-16T06:46:39.193969+0000","last_active":"2024-09-16T06:46:39.574113+0000","last_peered":"2024-09-16T06:46:39.574113+0000","last_clean":"2024-09-16T06:46:39.574113+0000","last_became_active":"2024-09-16T06:46:39.192961+0000","last_became_peered":"2024-09-16T06:46:39.192961+0000","last_unstale":"2024-09-16T06:46:39.574113+0000","last_undegraded":"2024-09-16T06:46:39.574113+0000","last_fullsized":"2024-09-16T06:46:39.574113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573980+0000","last_change":"2024-09-16T06:46:39.184373+0000","last_active":"2024-09-16T06:46:39.573980+0000","last_peered":"2024-09-16T06:46:39.573980+0000","last_clean":"2024-09-16T06:46:39.573980+0000","last_became_active":"2024-09-16T06:46:39.184103+0000","last_became_peered":"2024-09-16T06:46:39.184103+0000","last_unstale":"2024-09-16T06:46:39.573980+0000","last_undegraded":"2024-09-16T06:46:39.573980+0000","last_fullsized":"2024-09-16T06:46:39.573980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:30.289208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380924+0000","last_change":"2024-09-16T06:46:39.191359+0000","last_active":"2024-09-16T06:46:39.380924+0000","last_peered":"2024-09-16T06:46:39.380924+0000","last_clean":"2024-09-16T06:46:39.380924+0000","last_became_active":"2024-09-16T06:46:39.190629+0000","last_became_peered":"2024-09-16T06:46:39.190629+0000","last_unstale":"2024-09-16T06:46:39.380924+0000","last_undegraded":"2024-09-16T06:46:39.380924+0000","last_fullsized":"2024-09-16T06:46:39.380924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:59.386136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379403+0000","last_change":"2024-09-16T06:46:39.197414+0000","last_active":"2024-09-16T06:46:39.379403+0000","last_peered":"2024-09-16T06:46:39.379403+0000","last_clean":"2024-09-16T06:46:39.379403+0000","last_became_active":"2024-09-16T06:46:39.196383+0000","last_became_peered":"2024-09-16T06:46:39.196383+0000","last_unstale":"2024-09-16T06:46:39.379403+0000","last_undegraded":"2024-09-16T06:46:39.379403+0000","last_fullsized":"2024-09-16T06:46:39.379403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:47.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373509+0000","last_change":"2024-09-16T06:46:39.186113+0000","last_active":"2024-09-16T06:46:39.373509+0000","last_peered":"2024-09-16T06:46:39.373509+0000","last_clean":"2024-09-16T06:46:39.373509+0000","last_became_active":"2024-09-16T06:46:39.185724+0000","last_became_peered":"2024-09-16T06:46:39.185724+0000","last_unstale":"2024-09-16T06:46:39.373509+0000","last_undegraded":"2024-09-16T06:46:39.373509+0000","last_fullsized":"2024-09-16T06:46:39.373509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373223+0000","last_change":"2024-09-16T06:46:39.181680+0000","last_active":"2024-09-16T06:46:39.373223+0000","last_peered":"2024-09-16T06:46:39.373223+0000","last_clean":"2024-09-16T06:46:39.373223+0000","last_became_active":"2024-09-16T06:46:39.181381+0000","last_became_peered":"2024-09-16T06:46:39.181381+0000","last_unstale":"2024-09-16T06:46:39.373223+0000","last_undegraded":"2024-09-16T06:46:39.373223+0000","last_fullsized":"2024-09-16T06:46:39.373223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:55.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373121+0000","last_change":"2024-09-16T06:46:39.183260+0000","last_active":"2024-09-16T06:46:39.373121+0000","last_peered":"2024-09-16T06:46:39.373121+0000","last_clean":"2024-09-16T06:46:39.373121+0000","last_became_active":"2024-09-16T06:46:39.182535+0000","last_became_peered":"2024-09-16T06:46:39.182535+0000","last_unstale":"2024-09-16T06:46:39.373121+0000","last_undegraded":"2024-09-16T06:46:39.373121+0000","last_fullsized":"2024-09-16T06:46:39.373121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574519+0000","last_change":"2024-09-16T06:46:39.196964+0000","last_active":"2024-09-16T06:46:39.574519+0000","last_peered":"2024-09-16T06:46:39.574519+0000","last_clean":"2024-09-16T06:46:39.574519+0000","last_became_active":"2024-09-16T06:46:39.193222+0000","last_became_peered":"2024-09-16T06:46:39.193222+0000","last_unstale":"2024-09-16T06:46:39.574519+0000","last_undegraded":"2024-09-16T06:46:39.574519+0000","last_fullsized":"2024-09-16T06:46:39.574519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382683+0000","last_change":"2024-09-16T06:46:39.195440+0000","last_active":"2024-09-16T06:46:39.382683+0000","last_peered":"2024-09-16T06:46:39.382683+0000","last_clean":"2024-09-16T06:46:39.382683+0000","last_became_active":"2024-09-16T06:46:39.195077+0000","last_became_peered":"2024-09-16T06:46:39.195077+0000","last_unstale":"2024-09-16T06:46:39.382683+0000","last_undegraded":"2024-09-16T06:46:39.382683+0000","last_fullsized":"2024-09-16T06:46:39.382683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:33.780991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380368+0000","last_change":"2024-09-16T06:46:39.199081+0000","last_active":"2024-09-16T06:46:39.380368+0000","last_peered":"2024-09-16T06:46:39.380368+0000","last_clean":"2024-09-16T06:46:39.380368+0000","last_became_active":"2024-09-16T06:46:39.198665+0000","last_became_peered":"2024-09-16T06:46:39.198665+0000","last_unstale":"2024-09-16T06:46:39.380368+0000","last_undegraded":"2024-09-16T06:46:39.380368+0000","last_fullsized":"2024-09-16T06:46:39.380368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:15.738622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574478+0000","last_change":"2024-09-16T06:46:39.189862+0000","last_active":"2024-09-16T06:46:39.574478+0000","last_peered":"2024-09-16T06:46:39.574478+0000","last_clean":"2024-09-16T06:46:39.574478+0000","last_became_active":"2024-09-16T06:46:39.189621+0000","last_became_peered":"2024-09-16T06:46:39.189621+0000","last_unstale":"2024-09-16T06:46:39.574478+0000","last_undegraded":"2024-09-16T06:46:39.574478+0000","last_fullsized":"2024-09-16T06:46:39.574478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374382+0000","last_change":"2024-09-16T06:46:39.166523+0000","last_active":"2024-09-16T06:46:39.374382+0000","last_peered":"2024-09-16T06:46:39.374382+0000","last_clean":"2024-09-16T06:46:39.374382+0000","last_became_active":"2024-09-16T06:46:39.166080+0000","last_became_peered":"2024-09-16T06:46:39.166080+0000","last_unstale":"2024-09-16T06:46:39.374382+0000","last_undegraded":"2024-09-16T06:46:39.374382+0000","last_fullsized":"2024-09-16T06:46:39.374382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572873+0000","last_change":"2024-09-16T06:46:39.192493+0000","last_active":"2024-09-16T06:46:39.572873+0000","last_peered":"2024-09-16T06:46:39.572873+0000","last_clean":"2024-09-16T06:46:39.572873+0000","last_became_active":"2024-09-16T06:46:39.191125+0000","last_became_peered":"2024-09-16T06:46:39.191125+0000","last_unstale":"2024-09-16T06:46:39.572873+0000","last_undegraded":"2024-09-16T06:46:39.572873+0000","last_fullsized":"2024-09-16T06:46:39.572873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379291+0000","last_change":"2024-09-16T06:46:39.201662+0000","last_active":"2024-09-16T06:46:39.379291+0000","last_peered":"2024-09-16T06:46:39.379291+0000","last_clean":"2024-09-16T06:46:39.379291+0000","last_became_active":"2024-09-16T06:46:39.201128+0000","last_became_peered":"2024-09-16T06:46:39.201128+0000","last_unstale":"2024-09-16T06:46:39.379291+0000","last_undegraded":"2024-09-16T06:46:39.379291+0000","last_fullsized":"2024-09-16T06:46:39.379291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373162+0000","last_change":"2024-09-16T06:46:39.165959+0000","last_active":"2024-09-16T06:46:39.373162+0000","last_peered":"2024-09-16T06:46:39.373162+0000","last_clean":"2024-09-16T06:46:39.373162+0000","last_became_active":"2024-09-16T06:46:39.165699+0000","last_became_peered":"2024-09-16T06:46:39.165699+0000","last_unstale":"2024-09-16T06:46:39.373162+0000","last_undegraded":"2024-09-16T06:46:39.373162+0000","last_fullsized":"2024-09-16T06:46:39.373162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574135+0000","last_change":"2024-09-16T06:46:39.192215+0000","last_active":"2024-09-16T06:46:39.574135+0000","last_peered":"2024-09-16T06:46:39.574135+0000","last_clean":"2024-09-16T06:46:39.574135+0000","last_became_active":"2024-09-16T06:46:39.190823+0000","last_became_peered":"2024-09-16T06:46:39.190823+0000","last_unstale":"2024-09-16T06:46:39.574135+0000","last_undegraded":"2024-09-16T06:46:39.574135+0000","last_fullsized":"2024-09-16T06:46:39.574135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574361+0000","last_change":"2024-09-16T06:46:39.191593+0000","last_active":"2024-09-16T06:46:39.574361+0000","last_peered":"2024-09-16T06:46:39.574361+0000","last_clean":"2024-09-16T06:46:39.574361+0000","last_became_active":"2024-09-16T06:46:39.191301+0000","last_became_peered":"2024-09-16T06:46:39.191301+0000","last_unstale":"2024-09-16T06:46:39.574361+0000","last_undegraded":"2024-09-16T06:46:39.574361+0000","last_fullsized":"2024-09-16T06:46:39.574361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374814+0000","last_change":"2024-09-16T06:46:39.166105+0000","last_active":"2024-09-16T06:46:39.374814+0000","last_peered":"2024-09-16T06:46:39.374814+0000","last_clean":"2024-09-16T06:46:39.374814+0000","last_became_active":"2024-09-16T06:46:39.165575+0000","last_became_peered":"2024-09-16T06:46:39.165575+0000","last_unstale":"2024-09-16T06:46:39.374814+0000","last_undegraded":"2024-09-16T06:46:39.374814+0000","last_fullsized":"2024-09-16T06:46:39.374814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575020+0000","last_change":"2024-09-16T06:46:39.191790+0000","last_active":"2024-09-16T06:46:39.575020+0000","last_peered":"2024-09-16T06:46:39.575020+0000","last_clean":"2024-09-16T06:46:39.575020+0000","last_became_active":"2024-09-16T06:46:39.191549+0000","last_became_peered":"2024-09-16T06:46:39.191549+0000","last_unstale":"2024-09-16T06:46:39.575020+0000","last_undegraded":"2024-09-16T06:46:39.575020+0000","last_fullsized":"2024-09-16T06:46:39.575020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380372+0000","last_change":"2024-09-16T06:46:39.176484+0000","last_active":"2024-09-16T06:46:39.380372+0000","last_peered":"2024-09-16T06:46:39.380372+0000","last_clean":"2024-09-16T06:46:39.380372+0000","last_became_active":"2024-09-16T06:46:39.176214+0000","last_became_peered":"2024-09-16T06:46:39.176214+0000","last_unstale":"2024-09-16T06:46:39.380372+0000","last_undegraded":"2024-09-16T06:46:39.380372+0000","last_fullsized":"2024-09-16T06:46:39.380372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573144+0000","last_change":"2024-09-16T06:46:39.188928+0000","last_active":"2024-09-16T06:46:39.573144+0000","last_peered":"2024-09-16T06:46:39.573144+0000","last_clean":"2024-09-16T06:46:39.573144+0000","last_became_active":"2024-09-16T06:46:39.188620+0000","last_became_peered":"2024-09-16T06:46:39.188620+0000","last_unstale":"2024-09-16T06:46:39.573144+0000","last_undegraded":"2024-09-16T06:46:39.573144+0000","last_fullsized":"2024-09-16T06:46:39.573144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379459+0000","last_change":"2024-09-16T06:46:39.200952+0000","last_active":"2024-09-16T06:46:39.379459+0000","last_peered":"2024-09-16T06:46:39.379459+0000","last_clean":"2024-09-16T06:46:39.379459+0000","last_became_active":"2024-09-16T06:46:39.197413+0000","last_became_peered":"2024-09-16T06:46:39.197413+0000","last_unstale":"2024-09-16T06:46:39.379459+0000","last_undegraded":"2024-09-16T06:46:39.379459+0000","last_fullsized":"2024-09-16T06:46:39.379459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373219+0000","last_change":"2024-09-16T06:46:39.183560+0000","last_active":"2024-09-16T06:46:39.373219+0000","last_peered":"2024-09-16T06:46:39.373219+0000","last_clean":"2024-09-16T06:46:39.373219+0000","last_became_active":"2024-09-16T06:46:39.182899+0000","last_became_peered":"2024-09-16T06:46:39.182899+0000","last_unstale":"2024-09-16T06:46:39.373219+0000","last_undegraded":"2024-09-16T06:46:39.373219+0000","last_fullsized":"2024-09-16T06:46:39.373219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381984+0000","last_change":"2024-09-16T06:46:39.200486+0000","last_active":"2024-09-16T06:46:39.381984+0000","last_peered":"2024-09-16T06:46:39.381984+0000","last_clean":"2024-09-16T06:46:39.381984+0000","last_became_active":"2024-09-16T06:46:39.198054+0000","last_became_peered":"2024-09-16T06:46:39.198054+0000","last_unstale":"2024-09-16T06:46:39.381984+0000","last_undegraded":"2024-09-16T06:46:39.381984+0000","last_fullsized":"2024-09-16T06:46:39.381984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381262+0000","last_change":"2024-09-16T06:46:38.819482+0000","last_active":"2024-09-16T06:46:39.381262+0000","last_peered":"2024-09-16T06:46:39.381262+0000","last_clean":"2024-09-16T06:46:39.381262+0000","last_became_active":"2024-09-16T06:46:38.818284+0000","last_became_peered":"2024-09-16T06:46:38.818284+0000","last_unstale":"2024-09-16T06:46:39.381262+0000","last_undegraded":"2024-09-16T06:46:39.381262+0000","last_fullsized":"2024-09-16T06:46:39.381262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:20.195598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382318+0000","last_change":"2024-09-16T06:46:39.195870+0000","last_active":"2024-09-16T06:46:39.382318+0000","last_peered":"2024-09-16T06:46:39.382318+0000","last_clean":"2024-09-16T06:46:39.382318+0000","last_became_active":"2024-09-16T06:46:39.194071+0000","last_became_peered":"2024-09-16T06:46:39.194071+0000","last_unstale":"2024-09-16T06:46:39.382318+0000","last_undegraded":"2024-09-16T06:46:39.382318+0000","last_fullsized":"2024-09-16T06:46:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:53.619215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380249+0000","last_change":"2024-09-16T06:46:38.827083+0000","last_active":"2024-09-16T06:46:39.380249+0000","last_peered":"2024-09-16T06:46:39.380249+0000","last_clean":"2024-09-16T06:46:39.380249+0000","last_became_active":"2024-09-16T06:46:38.826329+0000","last_became_peered":"2024-09-16T06:46:38.826329+0000","last_unstale":"2024-09-16T06:46:39.380249+0000","last_undegraded":"2024-09-16T06:46:39.380249+0000","last_fullsized":"2024-09-16T06:46:39.380249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:23.891217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382370+0000","last_change":"2024-09-16T06:46:39.200568+0000","last_active":"2024-09-16T06:46:39.382370+0000","last_peered":"2024-09-16T06:46:39.382370+0000","last_clean":"2024-09-16T06:46:39.382370+0000","last_became_active":"2024-09-16T06:46:39.197902+0000","last_became_peered":"2024-09-16T06:46:39.197902+0000","last_unstale":"2024-09-16T06:46:39.382370+0000","last_undegraded":"2024-09-16T06:46:39.382370+0000","last_fullsized":"2024-09-16T06:46:39.382370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373400+0000","last_change":"2024-09-16T06:46:38.831919+0000","last_active":"2024-09-16T06:46:39.373400+0000","last_peered":"2024-09-16T06:46:39.373400+0000","last_clean":"2024-09-16T06:46:39.373400+0000","last_became_active":"2024-09-16T06:46:38.831609+0000","last_became_peered":"2024-09-16T06:46:38.831609+0000","last_unstale":"2024-09-16T06:46:39.373400+0000","last_undegraded":"2024-09-16T06:46:39.373400+0000","last_fullsized":"2024-09-16T06:46:39.373400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382988+0000","last_change":"2024-09-16T06:46:39.200573+0000","last_active":"2024-09-16T06:46:39.382988+0000","last_peered":"2024-09-16T06:46:39.382988+0000","last_clean":"2024-09-16T06:46:39.382988+0000","last_became_active":"2024-09-16T06:46:39.198472+0000","last_became_peered":"2024-09-16T06:46:39.198472+0000","last_unstale":"2024-09-16T06:46:39.382988+0000","last_undegraded":"2024-09-16T06:46:39.382988+0000","last_fullsized":"2024-09-16T06:46:39.382988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373251+0000","last_change":"2024-09-16T06:46:38.827569+0000","last_active":"2024-09-16T06:46:39.373251+0000","last_peered":"2024-09-16T06:46:39.373251+0000","last_clean":"2024-09-16T06:46:39.373251+0000","last_became_active":"2024-09-16T06:46:38.827207+0000","last_became_peered":"2024-09-16T06:46:38.827207+0000","last_unstale":"2024-09-16T06:46:39.373251+0000","last_undegraded":"2024-09-16T06:46:39.373251+0000","last_fullsized":"2024-09-16T06:46:39.373251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:03.087447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374993+0000","last_change":"2024-09-16T06:46:38.838219+0000","last_active":"2024-09-16T06:46:39.374993+0000","last_peered":"2024-09-16T06:46:39.374993+0000","last_clean":"2024-09-16T06:46:39.374993+0000","last_became_active":"2024-09-16T06:46:38.837847+0000","last_became_peered":"2024-09-16T06:46:38.837847+0000","last_unstale":"2024-09-16T06:46:39.374993+0000","last_undegraded":"2024-09-16T06:46:39.374993+0000","last_fullsized":"2024-09-16T06:46:39.374993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:29.278281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379022+0000","last_change":"2024-09-16T06:46:39.178965+0000","last_active":"2024-09-16T06:46:39.379022+0000","last_peered":"2024-09-16T06:46:39.379022+0000","last_clean":"2024-09-16T06:46:39.379022+0000","last_became_active":"2024-09-16T06:46:39.178626+0000","last_became_peered":"2024-09-16T06:46:39.178626+0000","last_unstale":"2024-09-16T06:46:39.379022+0000","last_undegraded":"2024-09-16T06:46:39.379022+0000","last_fullsized":"2024-09-16T06:46:39.379022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:07.184854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374813+0000","last_change":"2024-09-16T06:46:38.810716+0000","last_active":"2024-09-16T06:46:39.374813+0000","last_peered":"2024-09-16T06:46:39.374813+0000","last_clean":"2024-09-16T06:46:39.374813+0000","last_became_active":"2024-09-16T06:46:38.810300+0000","last_became_peered":"2024-09-16T06:46:38.810300+0000","last_unstale":"2024-09-16T06:46:39.374813+0000","last_undegraded":"2024-09-16T06:46:39.374813+0000","last_fullsized":"2024-09-16T06:46:39.374813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:45.971482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573028+0000","last_change":"2024-09-16T06:46:39.200612+0000","last_active":"2024-09-16T06:46:39.573028+0000","last_peered":"2024-09-16T06:46:39.573028+0000","last_clean":"2024-09-16T06:46:39.573028+0000","last_became_active":"2024-09-16T06:46:39.200182+0000","last_became_peered":"2024-09-16T06:46:39.200182+0000","last_unstale":"2024-09-16T06:46:39.573028+0000","last_undegraded":"2024-09-16T06:46:39.573028+0000","last_fullsized":"2024-09-16T06:46:39.573028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374666+0000","last_change":"2024-09-16T06:46:38.828295+0000","last_active":"2024-09-16T06:46:39.374666+0000","last_peered":"2024-09-16T06:46:39.374666+0000","last_clean":"2024-09-16T06:46:39.374666+0000","last_became_active":"2024-09-16T06:46:38.827978+0000","last_became_peered":"2024-09-16T06:46:38.827978+0000","last_unstale":"2024-09-16T06:46:39.374666+0000","last_undegraded":"2024-09-16T06:46:39.374666+0000","last_fullsized":"2024-09-16T06:46:39.374666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:41.144933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373659+0000","last_change":"2024-09-16T06:46:39.165852+0000","last_active":"2024-09-16T06:46:39.373659+0000","last_peered":"2024-09-16T06:46:39.373659+0000","last_clean":"2024-09-16T06:46:39.373659+0000","last_became_active":"2024-09-16T06:46:39.165606+0000","last_became_peered":"2024-09-16T06:46:39.165606+0000","last_unstale":"2024-09-16T06:46:39.373659+0000","last_undegraded":"2024-09-16T06:46:39.373659+0000","last_fullsized":"2024-09-16T06:46:39.373659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374787+0000","last_change":"2024-09-16T06:46:38.791462+0000","last_active":"2024-09-16T06:46:39.374787+0000","last_peered":"2024-09-16T06:46:39.374787+0000","last_clean":"2024-09-16T06:46:39.374787+0000","last_became_active":"2024-09-16T06:46:38.790888+0000","last_became_peered":"2024-09-16T06:46:38.790888+0000","last_unstale":"2024-09-16T06:46:39.374787+0000","last_undegraded":"2024-09-16T06:46:39.374787+0000","last_fullsized":"2024-09-16T06:46:39.374787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380151+0000","last_change":"2024-09-16T06:46:39.194753+0000","last_active":"2024-09-16T06:46:39.380151+0000","last_peered":"2024-09-16T06:46:39.380151+0000","last_clean":"2024-09-16T06:46:39.380151+0000","last_became_active":"2024-09-16T06:46:39.194441+0000","last_became_peered":"2024-09-16T06:46:39.194441+0000","last_unstale":"2024-09-16T06:46:39.380151+0000","last_undegraded":"2024-09-16T06:46:39.380151+0000","last_fullsized":"2024-09-16T06:46:39.380151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:10.938486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381628+0000","last_change":"2024-09-16T06:46:38.828919+0000","last_active":"2024-09-16T06:46:39.381628+0000","last_peered":"2024-09-16T06:46:39.381628+0000","last_clean":"2024-09-16T06:46:39.381628+0000","last_became_active":"2024-09-16T06:46:38.827632+0000","last_became_peered":"2024-09-16T06:46:38.827632+0000","last_unstale":"2024-09-16T06:46:39.381628+0000","last_undegraded":"2024-09-16T06:46:39.381628+0000","last_fullsized":"2024-09-16T06:46:39.381628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574796+0000","last_change":"2024-09-16T06:46:39.199721+0000","last_active":"2024-09-16T06:46:39.574796+0000","last_peered":"2024-09-16T06:46:39.574796+0000","last_clean":"2024-09-16T06:46:39.574796+0000","last_became_active":"2024-09-16T06:46:39.198781+0000","last_became_peered":"2024-09-16T06:46:39.198781+0000","last_unstale":"2024-09-16T06:46:39.574796+0000","last_undegraded":"2024-09-16T06:46:39.574796+0000","last_fullsized":"2024-09-16T06:46:39.574796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373852+0000","last_change":"2024-09-16T06:46:38.827548+0000","last_active":"2024-09-16T06:46:39.373852+0000","last_peered":"2024-09-16T06:46:39.373852+0000","last_clean":"2024-09-16T06:46:39.373852+0000","last_became_active":"2024-09-16T06:46:38.827223+0000","last_became_peered":"2024-09-16T06:46:38.827223+0000","last_unstale":"2024-09-16T06:46:39.373852+0000","last_undegraded":"2024-09-16T06:46:39.373852+0000","last_fullsized":"2024-09-16T06:46:39.373852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:24.775378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374413+0000","last_change":"2024-09-16T06:46:39.182960+0000","last_active":"2024-09-16T06:46:39.374413+0000","last_peered":"2024-09-16T06:46:39.374413+0000","last_clean":"2024-09-16T06:46:39.374413+0000","last_became_active":"2024-09-16T06:46:39.182729+0000","last_became_peered":"2024-09-16T06:46:39.182729+0000","last_unstale":"2024-09-16T06:46:39.374413+0000","last_undegraded":"2024-09-16T06:46:39.374413+0000","last_fullsized":"2024-09-16T06:46:39.374413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379585+0000","last_change":"2024-09-16T06:46:38.828147+0000","last_active":"2024-09-16T06:46:39.379585+0000","last_peered":"2024-09-16T06:46:39.379585+0000","last_clean":"2024-09-16T06:46:39.379585+0000","last_became_active":"2024-09-16T06:46:38.810187+0000","last_became_peered":"2024-09-16T06:46:38.810187+0000","last_unstale":"2024-09-16T06:46:39.379585+0000","last_undegraded":"2024-09-16T06:46:39.379585+0000","last_fullsized":"2024-09-16T06:46:39.379585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:49.449347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380665+0000","last_change":"2024-09-16T06:46:39.188782+0000","last_active":"2024-09-16T06:46:39.380665+0000","last_peered":"2024-09-16T06:46:39.380665+0000","last_clean":"2024-09-16T06:46:39.380665+0000","last_became_active":"2024-09-16T06:46:39.188111+0000","last_became_peered":"2024-09-16T06:46:39.188111+0000","last_unstale":"2024-09-16T06:46:39.380665+0000","last_undegraded":"2024-09-16T06:46:39.380665+0000","last_fullsized":"2024-09-16T06:46:39.380665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:42.155860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379176+0000","last_change":"2024-09-16T06:46:38.843585+0000","last_active":"2024-09-16T06:46:39.379176+0000","last_peered":"2024-09-16T06:46:39.379176+0000","last_clean":"2024-09-16T06:46:39.379176+0000","last_became_active":"2024-09-16T06:46:38.842948+0000","last_became_peered":"2024-09-16T06:46:38.842948+0000","last_unstale":"2024-09-16T06:46:39.379176+0000","last_undegraded":"2024-09-16T06:46:39.379176+0000","last_fullsized":"2024-09-16T06:46:39.379176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:35.981497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574259+0000","last_change":"2024-09-16T06:46:39.205252+0000","last_active":"2024-09-16T06:46:39.574259+0000","last_peered":"2024-09-16T06:46:39.574259+0000","last_clean":"2024-09-16T06:46:39.574259+0000","last_became_active":"2024-09-16T06:46:39.204938+0000","last_became_peered":"2024-09-16T06:46:39.204938+0000","last_unstale":"2024-09-16T06:46:39.574259+0000","last_undegraded":"2024-09-16T06:46:39.574259+0000","last_fullsized":"2024-09-16T06:46:39.574259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.172541+0000","last_change":"2024-09-16T06:46:28.420745+0000","last_active":"2024-09-16T06:46:39.172541+0000","last_peered":"2024-09-16T06:46:39.172541+0000","last_clean":"2024-09-16T06:46:39.172541+0000","last_became_active":"2024-09-16T06:46:28.419090+0000","last_became_peered":"2024-09-16T06:46:28.419090+0000","last_unstale":"2024-09-16T06:46:39.172541+0000","last_undegraded":"2024-09-16T06:46:39.172541+0000","last_fullsized":"2024-09-16T06:46:39.172541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_clean_scrub_stamp":"2024-09-16T06:46:27.264921+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:28:51.531389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374566+0000","last_change":"2024-09-16T06:46:34.591498+0000","last_active":"2024-09-16T06:46:39.374566+0000","last_peered":"2024-09-16T06:46:39.374566+0000","last_clean":"2024-09-16T06:46:39.374566+0000","last_became_active":"2024-09-16T06:46:32.591383+0000","last_became_peered":"2024-09-16T06:46:32.591383+0000","last_unstale":"2024-09-16T06:46:39.374566+0000","last_undegraded":"2024-09-16T06:46:39.374566+0000","last_fullsized":"2024-09-16T06:46:39.374566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:53.253566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010025520000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380170+0000","last_change":"2024-09-16T06:46:38.820440+0000","last_active":"2024-09-16T06:46:39.380170+0000","last_peered":"2024-09-16T06:46:39.380170+0000","last_clean":"2024-09-16T06:46:39.380170+0000","last_became_active":"2024-09-16T06:46:38.818437+0000","last_became_peered":"2024-09-16T06:46:38.818437+0000","last_unstale":"2024-09-16T06:46:39.380170+0000","last_undegraded":"2024-09-16T06:46:39.380170+0000","last_fullsized":"2024-09-16T06:46:39.380170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:04.350191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374591+0000","last_change":"2024-09-16T06:46:39.182247+0000","last_active":"2024-09-16T06:46:39.374591+0000","last_peered":"2024-09-16T06:46:39.374591+0000","last_clean":"2024-09-16T06:46:39.374591+0000","last_became_active":"2024-09-16T06:46:39.181061+0000","last_became_peered":"2024-09-16T06:46:39.181061+0000","last_unstale":"2024-09-16T06:46:39.374591+0000","last_undegraded":"2024-09-16T06:46:39.374591+0000","last_fullsized":"2024-09-16T06:46:39.374591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:11.090727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373360+0000","last_change":"2024-09-16T06:46:34.591483+0000","last_active":"2024-09-16T06:46:39.373360+0000","last_peered":"2024-09-16T06:46:39.373360+0000","last_clean":"2024-09-16T06:46:39.373360+0000","last_became_active":"2024-09-16T06:46:32.587817+0000","last_became_peered":"2024-09-16T06:46:32.587817+0000","last_unstale":"2024-09-16T06:46:39.373360+0000","last_undegraded":"2024-09-16T06:46:39.373360+0000","last_fullsized":"2024-09-16T06:46:39.373360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010582059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573485+0000","last_change":"2024-09-16T06:46:38.837265+0000","last_active":"2024-09-16T06:46:39.573485+0000","last_peered":"2024-09-16T06:46:39.573485+0000","last_clean":"2024-09-16T06:46:39.573485+0000","last_became_active":"2024-09-16T06:46:38.832115+0000","last_became_peered":"2024-09-16T06:46:38.832115+0000","last_unstale":"2024-09-16T06:46:39.573485+0000","last_undegraded":"2024-09-16T06:46:39.573485+0000","last_fullsized":"2024-09-16T06:46:39.573485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:06.148145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382717+0000","last_change":"2024-09-16T06:46:39.200924+0000","last_active":"2024-09-16T06:46:39.382717+0000","last_peered":"2024-09-16T06:46:39.382717+0000","last_clean":"2024-09-16T06:46:39.382717+0000","last_became_active":"2024-09-16T06:46:39.200607+0000","last_became_peered":"2024-09-16T06:46:39.200607+0000","last_unstale":"2024-09-16T06:46:39.382717+0000","last_undegraded":"2024-09-16T06:46:39.382717+0000","last_fullsized":"2024-09-16T06:46:39.382717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379692+0000","last_change":"2024-09-16T06:46:34.715640+0000","last_active":"2024-09-16T06:46:39.379692+0000","last_peered":"2024-09-16T06:46:39.379692+0000","last_clean":"2024-09-16T06:46:39.379692+0000","last_became_active":"2024-09-16T06:46:32.593992+0000","last_became_peered":"2024-09-16T06:46:32.593992+0000","last_unstale":"2024-09-16T06:46:39.379692+0000","last_undegraded":"2024-09-16T06:46:39.379692+0000","last_fullsized":"2024-09-16T06:46:39.379692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:30.696024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051250899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572853+0000","last_change":"2024-09-16T06:46:38.831231+0000","last_active":"2024-09-16T06:46:39.572853+0000","last_peered":"2024-09-16T06:46:39.572853+0000","last_clean":"2024-09-16T06:46:39.572853+0000","last_became_active":"2024-09-16T06:46:38.830405+0000","last_became_peered":"2024-09-16T06:46:38.830405+0000","last_unstale":"2024-09-16T06:46:39.572853+0000","last_undegraded":"2024-09-16T06:46:39.572853+0000","last_fullsized":"2024-09-16T06:46:39.572853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574391+0000","last_change":"2024-09-16T06:46:39.199732+0000","last_active":"2024-09-16T06:46:39.574391+0000","last_peered":"2024-09-16T06:46:39.574391+0000","last_clean":"2024-09-16T06:46:39.574391+0000","last_became_active":"2024-09-16T06:46:39.199407+0000","last_became_peered":"2024-09-16T06:46:39.199407+0000","last_unstale":"2024-09-16T06:46:39.574391+0000","last_undegraded":"2024-09-16T06:46:39.574391+0000","last_fullsized":"2024-09-16T06:46:39.574391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373924+0000","last_change":"2024-09-16T06:46:34.592232+0000","last_active":"2024-09-16T06:46:39.373924+0000","last_peered":"2024-09-16T06:46:39.373924+0000","last_clean":"2024-09-16T06:46:39.373924+0000","last_became_active":"2024-09-16T06:46:32.584409+0000","last_became_peered":"2024-09-16T06:46:32.584409+0000","last_unstale":"2024-09-16T06:46:39.373924+0000","last_undegraded":"2024-09-16T06:46:39.373924+0000","last_fullsized":"2024-09-16T06:46:39.373924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001754603,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374471+0000","last_change":"2024-09-16T06:46:38.815767+0000","last_active":"2024-09-16T06:46:39.374471+0000","last_peered":"2024-09-16T06:46:39.374471+0000","last_clean":"2024-09-16T06:46:39.374471+0000","last_became_active":"2024-09-16T06:46:38.815553+0000","last_became_peered":"2024-09-16T06:46:38.815553+0000","last_unstale":"2024-09-16T06:46:39.374471+0000","last_undegraded":"2024-09-16T06:46:39.374471+0000","last_fullsized":"2024-09-16T06:46:39.374471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:03.610912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574733+0000","last_change":"2024-09-16T06:46:39.194564+0000","last_active":"2024-09-16T06:46:39.574733+0000","last_peered":"2024-09-16T06:46:39.574733+0000","last_clean":"2024-09-16T06:46:39.574733+0000","last_became_active":"2024-09-16T06:46:39.194168+0000","last_became_peered":"2024-09-16T06:46:39.194168+0000","last_unstale":"2024-09-16T06:46:39.574733+0000","last_undegraded":"2024-09-16T06:46:39.574733+0000","last_fullsized":"2024-09-16T06:46:39.574733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374696+0000","last_change":"2024-09-16T06:46:38.828799+0000","last_active":"2024-09-16T06:46:39.374696+0000","last_peered":"2024-09-16T06:46:39.374696+0000","last_clean":"2024-09-16T06:46:39.374696+0000","last_became_active":"2024-09-16T06:46:38.828136+0000","last_became_peered":"2024-09-16T06:46:38.828136+0000","last_unstale":"2024-09-16T06:46:39.374696+0000","last_undegraded":"2024-09-16T06:46:39.374696+0000","last_fullsized":"2024-09-16T06:46:39.374696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:33.286790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575150+0000","last_change":"2024-09-16T06:46:34.595510+0000","last_active":"2024-09-16T06:46:39.575150+0000","last_peered":"2024-09-16T06:46:39.575150+0000","last_clean":"2024-09-16T06:46:39.575150+0000","last_became_active":"2024-09-16T06:46:32.588966+0000","last_became_peered":"2024-09-16T06:46:32.588966+0000","last_unstale":"2024-09-16T06:46:39.575150+0000","last_undegraded":"2024-09-16T06:46:39.575150+0000","last_fullsized":"2024-09-16T06:46:39.575150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082793000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572993+0000","last_change":"2024-09-16T06:46:39.192738+0000","last_active":"2024-09-16T06:46:39.572993+0000","last_peered":"2024-09-16T06:46:39.572993+0000","last_clean":"2024-09-16T06:46:39.572993+0000","last_became_active":"2024-09-16T06:46:39.192227+0000","last_became_peered":"2024-09-16T06:46:39.192227+0000","last_unstale":"2024-09-16T06:46:39.572993+0000","last_undegraded":"2024-09-16T06:46:39.572993+0000","last_fullsized":"2024-09-16T06:46:39.572993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575058+0000","last_change":"2024-09-16T06:46:38.836459+0000","last_active":"2024-09-16T06:46:39.575058+0000","last_peered":"2024-09-16T06:46:39.575058+0000","last_clean":"2024-09-16T06:46:39.575058+0000","last_became_active":"2024-09-16T06:46:38.832248+0000","last_became_peered":"2024-09-16T06:46:38.832248+0000","last_unstale":"2024-09-16T06:46:39.575058+0000","last_undegraded":"2024-09-16T06:46:39.575058+0000","last_fullsized":"2024-09-16T06:46:39.575058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:56.866622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374900+0000","last_change":"2024-09-16T06:46:34.592592+0000","last_active":"2024-09-16T06:46:39.374900+0000","last_peered":"2024-09-16T06:46:39.374900+0000","last_clean":"2024-09-16T06:46:39.374900+0000","last_became_active":"2024-09-16T06:46:32.591488+0000","last_became_peered":"2024-09-16T06:46:32.591488+0000","last_unstale":"2024-09-16T06:46:39.374900+0000","last_undegraded":"2024-09-16T06:46:39.374900+0000","last_fullsized":"2024-09-16T06:46:39.374900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:46:25.248987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018038799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573210+0000","last_change":"2024-09-16T06:46:39.193260+0000","last_active":"2024-09-16T06:46:39.573210+0000","last_peered":"2024-09-16T06:46:39.573210+0000","last_clean":"2024-09-16T06:46:39.573210+0000","last_became_active":"2024-09-16T06:46:39.192979+0000","last_became_peered":"2024-09-16T06:46:39.192979+0000","last_unstale":"2024-09-16T06:46:39.573210+0000","last_undegraded":"2024-09-16T06:46:39.573210+0000","last_fullsized":"2024-09-16T06:46:39.573210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.383066+0000","last_change":"2024-09-16T06:46:38.843068+0000","last_active":"2024-09-16T06:46:39.383066+0000","last_peered":"2024-09-16T06:46:39.383066+0000","last_clean":"2024-09-16T06:46:39.383066+0000","last_became_active":"2024-09-16T06:46:38.842540+0000","last_became_peered":"2024-09-16T06:46:38.842540+0000","last_unstale":"2024-09-16T06:46:39.383066+0000","last_undegraded":"2024-09-16T06:46:39.383066+0000","last_fullsized":"2024-09-16T06:46:39.383066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574707+0000","last_change":"2024-09-16T06:46:34.595534+0000","last_active":"2024-09-16T06:46:39.574707+0000","last_peered":"2024-09-16T06:46:39.574707+0000","last_clean":"2024-09-16T06:46:39.574707+0000","last_became_active":"2024-09-16T06:46:32.591633+0000","last_became_peered":"2024-09-16T06:46:32.591633+0000","last_unstale":"2024-09-16T06:46:39.574707+0000","last_undegraded":"2024-09-16T06:46:39.574707+0000","last_fullsized":"2024-09-16T06:46:39.574707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084554300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379049+0000","last_change":"2024-09-16T06:46:39.198185+0000","last_active":"2024-09-16T06:46:39.379049+0000","last_peered":"2024-09-16T06:46:39.379049+0000","last_clean":"2024-09-16T06:46:39.379049+0000","last_became_active":"2024-09-16T06:46:39.197829+0000","last_became_peered":"2024-09-16T06:46:39.197829+0000","last_unstale":"2024-09-16T06:46:39.379049+0000","last_undegraded":"2024-09-16T06:46:39.379049+0000","last_fullsized":"2024-09-16T06:46:39.379049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.768079+0000","last_change":"2024-09-16T06:46:38.824771+0000","last_active":"2024-09-16T06:46:39.768079+0000","last_peered":"2024-09-16T06:46:39.768079+0000","last_clean":"2024-09-16T06:46:39.768079+0000","last_became_active":"2024-09-16T06:46:38.824096+0000","last_became_peered":"2024-09-16T06:46:38.824096+0000","last_unstale":"2024-09-16T06:46:39.768079+0000","last_undegraded":"2024-09-16T06:46:39.768079+0000","last_fullsized":"2024-09-16T06:46:39.768079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.375046+0000","last_change":"2024-09-16T06:46:34.592095+0000","last_active":"2024-09-16T06:46:39.375046+0000","last_peered":"2024-09-16T06:46:39.375046+0000","last_clean":"2024-09-16T06:46:39.375046+0000","last_became_active":"2024-09-16T06:46:32.585129+0000","last_became_peered":"2024-09-16T06:46:32.585129+0000","last_unstale":"2024-09-16T06:46:39.375046+0000","last_undegraded":"2024-09-16T06:46:39.375046+0000","last_fullsized":"2024-09-16T06:46:39.375046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:55.521712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015900179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379347+0000","last_change":"2024-09-16T06:46:39.187196+0000","last_active":"2024-09-16T06:46:39.379347+0000","last_peered":"2024-09-16T06:46:39.379347+0000","last_clean":"2024-09-16T06:46:39.379347+0000","last_became_active":"2024-09-16T06:46:39.184981+0000","last_became_peered":"2024-09-16T06:46:39.184981+0000","last_unstale":"2024-09-16T06:46:39.379347+0000","last_undegraded":"2024-09-16T06:46:39.379347+0000","last_fullsized":"2024-09-16T06:46:39.379347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:34.297717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379916+0000","last_change":"2024-09-16T06:46:39.185361+0000","last_active":"2024-09-16T06:46:39.379916+0000","last_peered":"2024-09-16T06:46:39.379916+0000","last_clean":"2024-09-16T06:46:39.379916+0000","last_became_active":"2024-09-16T06:46:39.185017+0000","last_became_peered":"2024-09-16T06:46:39.185017+0000","last_unstale":"2024-09-16T06:46:39.379916+0000","last_undegraded":"2024-09-16T06:46:39.379916+0000","last_fullsized":"2024-09-16T06:46:39.379916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:57.877549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374658+0000","last_change":"2024-09-16T06:46:38.804787+0000","last_active":"2024-09-16T06:46:39.374658+0000","last_peered":"2024-09-16T06:46:39.374658+0000","last_clean":"2024-09-16T06:46:39.374658+0000","last_became_active":"2024-09-16T06:46:38.804503+0000","last_became_peered":"2024-09-16T06:46:38.804503+0000","last_unstale":"2024-09-16T06:46:39.374658+0000","last_undegraded":"2024-09-16T06:46:39.374658+0000","last_fullsized":"2024-09-16T06:46:39.374658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:58.375210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573446+0000","last_change":"2024-09-16T06:46:39.185466+0000","last_active":"2024-09-16T06:46:39.573446+0000","last_peered":"2024-09-16T06:46:39.573446+0000","last_clean":"2024-09-16T06:46:39.573446+0000","last_became_active":"2024-09-16T06:46:39.185188+0000","last_became_peered":"2024-09-16T06:46:39.185188+0000","last_unstale":"2024-09-16T06:46:39.573446+0000","last_undegraded":"2024-09-16T06:46:39.573446+0000","last_fullsized":"2024-09-16T06:46:39.573446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381315+0000","last_change":"2024-09-16T06:46:38.826430+0000","last_active":"2024-09-16T06:46:39.381315+0000","last_peered":"2024-09-16T06:46:39.381315+0000","last_clean":"2024-09-16T06:46:39.381315+0000","last_became_active":"2024-09-16T06:46:38.825763+0000","last_became_peered":"2024-09-16T06:46:38.825763+0000","last_unstale":"2024-09-16T06:46:39.381315+0000","last_undegraded":"2024-09-16T06:46:39.381315+0000","last_fullsized":"2024-09-16T06:46:39.381315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:55.060544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374601+0000","last_change":"2024-09-16T06:46:38.828786+0000","last_active":"2024-09-16T06:46:39.374601+0000","last_peered":"2024-09-16T06:46:39.374601+0000","last_clean":"2024-09-16T06:46:39.374601+0000","last_became_active":"2024-09-16T06:46:38.827157+0000","last_became_peered":"2024-09-16T06:46:38.827157+0000","last_unstale":"2024-09-16T06:46:39.374601+0000","last_undegraded":"2024-09-16T06:46:39.374601+0000","last_fullsized":"2024-09-16T06:46:39.374601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:10:03.077384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379573+0000","last_change":"2024-09-16T06:46:39.195693+0000","last_active":"2024-09-16T06:46:39.379573+0000","last_peered":"2024-09-16T06:46:39.379573+0000","last_clean":"2024-09-16T06:46:39.379573+0000","last_became_active":"2024-09-16T06:46:39.180517+0000","last_became_peered":"2024-09-16T06:46:39.180517+0000","last_unstale":"2024-09-16T06:46:39.379573+0000","last_undegraded":"2024-09-16T06:46:39.379573+0000","last_fullsized":"2024-09-16T06:46:39.379573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:16.222534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574953+0000","last_change":"2024-09-16T06:46:38.842337+0000","last_active":"2024-09-16T06:46:39.574953+0000","last_peered":"2024-09-16T06:46:39.574953+0000","last_clean":"2024-09-16T06:46:39.574953+0000","last_became_active":"2024-09-16T06:46:38.841847+0000","last_became_peered":"2024-09-16T06:46:38.841847+0000","last_unstale":"2024-09-16T06:46:39.574953+0000","last_undegraded":"2024-09-16T06:46:39.574953+0000","last_fullsized":"2024-09-16T06:46:39.574953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.378908+0000","last_change":"2024-09-16T06:46:39.186930+0000","last_active":"2024-09-16T06:46:39.378908+0000","last_peered":"2024-09-16T06:46:39.378908+0000","last_clean":"2024-09-16T06:46:39.378908+0000","last_became_active":"2024-09-16T06:46:39.179564+0000","last_became_peered":"2024-09-16T06:46:39.179564+0000","last_unstale":"2024-09-16T06:46:39.378908+0000","last_undegraded":"2024-09-16T06:46:39.378908+0000","last_fullsized":"2024-09-16T06:46:39.378908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374942+0000","last_change":"2024-09-16T06:46:39.175212+0000","last_active":"2024-09-16T06:46:39.374942+0000","last_peered":"2024-09-16T06:46:39.374942+0000","last_clean":"2024-09-16T06:46:39.374942+0000","last_became_active":"2024-09-16T06:46:39.175010+0000","last_became_peered":"2024-09-16T06:46:39.175010+0000","last_unstale":"2024-09-16T06:46:39.374942+0000","last_undegraded":"2024-09-16T06:46:39.374942+0000","last_fullsized":"2024-09-16T06:46:39.374942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379170+0000","last_change":"2024-09-16T06:46:38.833982+0000","last_active":"2024-09-16T06:46:39.379170+0000","last_peered":"2024-09-16T06:46:39.379170+0000","last_clean":"2024-09-16T06:46:39.379170+0000","last_became_active":"2024-09-16T06:46:38.833337+0000","last_became_peered":"2024-09-16T06:46:38.833337+0000","last_unstale":"2024-09-16T06:46:39.379170+0000","last_undegraded":"2024-09-16T06:46:39.379170+0000","last_fullsized":"2024-09-16T06:46:39.379170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574266+0000","last_change":"2024-09-16T06:46:39.192612+0000","last_active":"2024-09-16T06:46:39.574266+0000","last_peered":"2024-09-16T06:46:39.574266+0000","last_clean":"2024-09-16T06:46:39.574266+0000","last_became_active":"2024-09-16T06:46:39.192292+0000","last_became_peered":"2024-09-16T06:46:39.192292+0000","last_unstale":"2024-09-16T06:46:39.574266+0000","last_undegraded":"2024-09-16T06:46:39.574266+0000","last_fullsized":"2024-09-16T06:46:39.574266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573272+0000","last_change":"2024-09-16T06:46:38.845796+0000","last_active":"2024-09-16T06:46:39.573272+0000","last_peered":"2024-09-16T06:46:39.573272+0000","last_clean":"2024-09-16T06:46:39.573272+0000","last_became_active":"2024-09-16T06:46:38.845067+0000","last_became_peered":"2024-09-16T06:46:38.845067+0000","last_unstale":"2024-09-16T06:46:39.573272+0000","last_undegraded":"2024-09-16T06:46:39.573272+0000","last_fullsized":"2024-09-16T06:46:39.573272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:46.841092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382233+0000","last_change":"2024-09-16T06:46:39.197876+0000","last_active":"2024-09-16T06:46:39.382233+0000","last_peered":"2024-09-16T06:46:39.382233+0000","last_clean":"2024-09-16T06:46:39.382233+0000","last_became_active":"2024-09-16T06:46:39.197577+0000","last_became_peered":"2024-09-16T06:46:39.197577+0000","last_unstale":"2024-09-16T06:46:39.382233+0000","last_undegraded":"2024-09-16T06:46:39.382233+0000","last_fullsized":"2024-09-16T06:46:39.382233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:38.035227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373743+0000","last_change":"2024-09-16T06:46:38.828782+0000","last_active":"2024-09-16T06:46:39.373743+0000","last_peered":"2024-09-16T06:46:39.373743+0000","last_clean":"2024-09-16T06:46:39.373743+0000","last_became_active":"2024-09-16T06:46:38.827397+0000","last_became_peered":"2024-09-16T06:46:38.827397+0000","last_unstale":"2024-09-16T06:46:39.373743+0000","last_undegraded":"2024-09-16T06:46:39.373743+0000","last_fullsized":"2024-09-16T06:46:39.373743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:13.559277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380975+0000","last_change":"2024-09-16T06:46:39.197981+0000","last_active":"2024-09-16T06:46:39.380975+0000","last_peered":"2024-09-16T06:46:39.380975+0000","last_clean":"2024-09-16T06:46:39.380975+0000","last_became_active":"2024-09-16T06:46:39.197563+0000","last_became_peered":"2024-09-16T06:46:39.197563+0000","last_unstale":"2024-09-16T06:46:39.380975+0000","last_undegraded":"2024-09-16T06:46:39.380975+0000","last_fullsized":"2024-09-16T06:46:39.380975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:04.098374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380879+0000","last_change":"2024-09-16T06:46:38.820441+0000","last_active":"2024-09-16T06:46:39.380879+0000","last_peered":"2024-09-16T06:46:39.380879+0000","last_clean":"2024-09-16T06:46:39.380879+0000","last_became_active":"2024-09-16T06:46:38.819557+0000","last_became_peered":"2024-09-16T06:46:38.819557+0000","last_unstale":"2024-09-16T06:46:39.380879+0000","last_undegraded":"2024-09-16T06:46:39.380879+0000","last_fullsized":"2024-09-16T06:46:39.380879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:53.345033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379674+0000","last_change":"2024-09-16T06:46:39.195683+0000","last_active":"2024-09-16T06:46:39.379674+0000","last_peered":"2024-09-16T06:46:39.379674+0000","last_clean":"2024-09-16T06:46:39.379674+0000","last_became_active":"2024-09-16T06:46:39.195257+0000","last_became_peered":"2024-09-16T06:46:39.195257+0000","last_unstale":"2024-09-16T06:46:39.379674+0000","last_undegraded":"2024-09-16T06:46:39.379674+0000","last_fullsized":"2024-09-16T06:46:39.379674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:45.567439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574872+0000","last_change":"2024-09-16T06:46:38.845647+0000","last_active":"2024-09-16T06:46:39.574872+0000","last_peered":"2024-09-16T06:46:39.574872+0000","last_clean":"2024-09-16T06:46:39.574872+0000","last_became_active":"2024-09-16T06:46:38.842456+0000","last_became_peered":"2024-09-16T06:46:38.842456+0000","last_unstale":"2024-09-16T06:46:39.574872+0000","last_undegraded":"2024-09-16T06:46:39.574872+0000","last_fullsized":"2024-09-16T06:46:39.574872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373566+0000","last_change":"2024-09-16T06:46:39.165157+0000","last_active":"2024-09-16T06:46:39.373566+0000","last_peered":"2024-09-16T06:46:39.373566+0000","last_clean":"2024-09-16T06:46:39.373566+0000","last_became_active":"2024-09-16T06:46:39.164481+0000","last_became_peered":"2024-09-16T06:46:39.164481+0000","last_unstale":"2024-09-16T06:46:39.373566+0000","last_undegraded":"2024-09-16T06:46:39.373566+0000","last_fullsized":"2024-09-16T06:46:39.373566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:33.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374569+0000","last_change":"2024-09-16T06:46:38.811325+0000","last_active":"2024-09-16T06:46:39.374569+0000","last_peered":"2024-09-16T06:46:39.374569+0000","last_clean":"2024-09-16T06:46:39.374569+0000","last_became_active":"2024-09-16T06:46:38.811045+0000","last_became_peered":"2024-09-16T06:46:38.811045+0000","last_unstale":"2024-09-16T06:46:39.374569+0000","last_undegraded":"2024-09-16T06:46:39.374569+0000","last_fullsized":"2024-09-16T06:46:39.374569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:09.927559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379772+0000","last_change":"2024-09-16T06:46:39.201473+0000","last_active":"2024-09-16T06:46:39.379772+0000","last_peered":"2024-09-16T06:46:39.379772+0000","last_clean":"2024-09-16T06:46:39.379772+0000","last_became_active":"2024-09-16T06:46:39.195802+0000","last_became_peered":"2024-09-16T06:46:39.195802+0000","last_unstale":"2024-09-16T06:46:39.379772+0000","last_undegraded":"2024-09-16T06:46:39.379772+0000","last_fullsized":"2024-09-16T06:46:39.379772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382822+0000","last_change":"2024-09-16T06:46:38.818893+0000","last_active":"2024-09-16T06:46:39.382822+0000","last_peered":"2024-09-16T06:46:39.382822+0000","last_clean":"2024-09-16T06:46:39.382822+0000","last_became_active":"2024-09-16T06:46:38.818126+0000","last_became_peered":"2024-09-16T06:46:38.818126+0000","last_unstale":"2024-09-16T06:46:39.382822+0000","last_undegraded":"2024-09-16T06:46:39.382822+0000","last_fullsized":"2024-09-16T06:46:39.382822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:07:21.946452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373312+0000","last_change":"2024-09-16T06:46:39.181737+0000","last_active":"2024-09-16T06:46:39.373312+0000","last_peered":"2024-09-16T06:46:39.373312+0000","last_clean":"2024-09-16T06:46:39.373312+0000","last_became_active":"2024-09-16T06:46:39.181022+0000","last_became_peered":"2024-09-16T06:46:39.181022+0000","last_unstale":"2024-09-16T06:46:39.373312+0000","last_undegraded":"2024-09-16T06:46:39.373312+0000","last_fullsized":"2024-09-16T06:46:39.373312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574823+0000","last_change":"2024-09-16T06:46:38.845870+0000","last_active":"2024-09-16T06:46:39.574823+0000","last_peered":"2024-09-16T06:46:39.574823+0000","last_clean":"2024-09-16T06:46:39.574823+0000","last_became_active":"2024-09-16T06:46:38.837200+0000","last_became_peered":"2024-09-16T06:46:38.837200+0000","last_unstale":"2024-09-16T06:46:39.574823+0000","last_undegraded":"2024-09-16T06:46:39.574823+0000","last_fullsized":"2024-09-16T06:46:39.574823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":65043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":657453,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":655840,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":66558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T06:46:46.350 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T06:46:46.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0759eb6640 1 Processor -- start 2024-09-16T06:46:46.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0759eb6640 1 -- start start 2024-09-16T06:46:46.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0759eb6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f07540b9c20 0x7f07540a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0759eb6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0754139dc0 0x7f0754147420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0759eb6640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07540abc00 con 0x7f0754147960 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0759eb6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0754146c80 con 0x7f07540b9c20 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0759eb6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0754146f40 con 0x7f0754139dc0 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0752ffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0754139dc0 0x7f0754147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0752ffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0754139dc0 0x7f0754147420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56192/0 (socket says 172.21.15.96:56192) 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0752ffd640 1 -- 172.21.15.96:0/621115471 learned_addr learned my addr 172.21.15.96:0/621115471 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f07537fe640 1 --2- 172.21.15.96:0/621115471 >> v2:172.21.15.96:3300/0 conn(0x7f07540b9c20 0x7f07540a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0752ffd640 1 -- 172.21.15.96:0/621115471 >> v2:172.21.15.96:3300/0 conn(0x7f07540b9c20 msgr2=0x7f07540a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0752ffd640 1 --2- 172.21.15.96:0/621115471 >> v2:172.21.15.96:3300/0 conn(0x7f07540b9c20 0x7f07540a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0752ffd640 1 -- 172.21.15.96:0/621115471 >> v1:172.21.15.134:6789/0 conn(0x7f0754147960 legacy=0x7f07540aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:46.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.503+0000 7f0752ffd640 1 -- 172.21.15.96:0/621115471 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540a8500 con 0x7f0754139dc0 2024-09-16T06:46:46.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0752ffd640 1 --2- 172.21.15.96:0/621115471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0754139dc0 0x7f0754147420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0748009870 tx=0x7f074801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=349735fa94558327 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f07527fc640 1 -- 172.21.15.96:0/621115471 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480ab650 con 0x7f0754139dc0 2024-09-16T06:46:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f07527fc640 1 -- 172.21.15.96:0/621115471 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480ab7b0 con 0x7f0754139dc0 2024-09-16T06:46:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f07527fc640 1 -- 172.21.15.96:0/621115471 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480abb40 con 0x7f0754139dc0 2024-09-16T06:46:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- 172.21.15.96:0/621115471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0754139dc0 msgr2=0x7f0754147420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 --2- 172.21.15.96:0/621115471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0754139dc0 0x7f0754147420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0748009870 tx=0x7f074801c470 comp rx=0 tx=0).stop 2024-09-16T06:46:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- 172.21.15.96:0/621115471 shutdown_connections 2024-09-16T06:46:46.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 --2- 172.21.15.96:0/621115471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0754139dc0 0x7f0754147420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 --2- 172.21.15.96:0/621115471 >> v2:172.21.15.96:3300/0 conn(0x7f07540b9c20 0x7f07540a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- 172.21.15.96:0/621115471 >> 172.21.15.96:0/621115471 conn(0x7f075406b4a0 msgr2=0x7f075406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- 172.21.15.96:0/621115471 shutdown_connections 2024-09-16T06:46:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- 172.21.15.96:0/621115471 wait complete. 2024-09-16T06:46:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 Processor -- start 2024-09-16T06:46:46.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- start start 2024-09-16T06:46:46.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07540b9c20 0x7f07540b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754139dc0 0x7f07540ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0754147960 0x7f0754070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540ad110 con 0x7f0754147960 2024-09-16T06:46:46.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07541df4c0 con 0x7f0754139dc0 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0759eb6640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07541df780 con 0x7f07540b9c20 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f07537fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07540b9c20 0x7f07540b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f0753fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0754147960 0x7f0754070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f07537fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07540b9c20 0x7f07540b6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56208/0 (socket says 172.21.15.96:56208) 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.507+0000 7f07537fe640 1 -- 172.21.15.96:0/2210236554 learned_addr learned my addr 172.21.15.96:0/2210236554 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0752ffd640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754139dc0 0x7f07540ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0753fff640 1 -- 172.21.15.96:0/2210236554 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07540b9c20 msgr2=0x7f07540b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0753fff640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07540b9c20 0x7f07540b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0753fff640 1 -- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754139dc0 msgr2=0x7f07540ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0753fff640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754139dc0 0x7f07540ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0753fff640 1 -- 172.21.15.96:0/2210236554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07480094d0 con 0x7f0754147960 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0752ffd640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754139dc0 0x7f07540ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:46.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0753fff640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0754147960 0x7f0754070600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07540738c0 tx=0x7f074c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 1 -- 172.21.15.96:0/2210236554 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00cdf0 con 0x7f0754147960 2024-09-16T06:46:46.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 1 -- 172.21.15.96:0/2210236554 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c014440 con 0x7f0754147960 2024-09-16T06:46:46.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754144160 con 0x7f0754147960 2024-09-16T06:46:46.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 1 -- 172.21.15.96:0/2210236554 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c014830 con 0x7f0754147960 2024-09-16T06:46:46.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07540adde0 con 0x7f0754147960 2024-09-16T06:46:46.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07540ad5c0 con 0x7f0754147960 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 1 -- 172.21.15.96:0/2210236554 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f074c003980 con 0x7f0754147960 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0740097840 0x7f0740099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f073bfff640 1 -- 172.21.15.96:0/2210236554 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f074c0bfbd0 con 0x7f0754147960 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.511+0000 7f07537fe640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0740097840 0x7f0740099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.515+0000 7f07537fe640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0740097840 0x7f0740099d00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0744009c20 tx=0x7f0744009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.515+0000 7f073bfff640 1 -- 172.21.15.96:0/2210236554 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f074c08d370 con 0x7f0754147960 2024-09-16T06:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.659+0000 7f0759eb6640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2024-09-16T06:46:46.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.659+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 --> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07540aa0b0 con 0x7f0740097840 2024-09-16T06:46:46.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.679+0000 7f073bfff640 1 -- 172.21.15.96:0/2210236554 <== mgr.4105 v2:172.21.15.134:6824/468510839 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271571 (secure 0 0 0) 0x7f07540aa0b0 con 0x7f0740097840 2024-09-16T06:46:46.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.679+0000 7f073bfff640 20 mgrc handle_command_reply tid 0 r 0 2024-09-16T06:46:46.685 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:46.686 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-09-16T06:46:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 10 mgrc shutdown 2024-09-16T06:46:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0740097840 msgr2=0x7f0740099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0740097840 0x7f0740099d00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0744009c20 tx=0x7f0744009190 comp rx=0 tx=0).stop 2024-09-16T06:46:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0754147960 msgr2=0x7f0754070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0754147960 0x7f0754070600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07540738c0 tx=0x7f074c009ed0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 shutdown_connections 2024-09-16T06:46:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0740097840 0x7f0740099d00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0754147960 0x7f0754070600 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0754139dc0 0x7f07540ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 --2- 172.21.15.96:0/2210236554 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f07540b9c20 0x7f07540b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 >> 172.21.15.96:0/2210236554 conn(0x7f075406b4a0 msgr2=0x7f07540b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 shutdown_connections 2024-09-16T06:46:46.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.683+0000 7f0759eb6640 1 -- 172.21.15.96:0/2210236554 wait complete. 2024-09-16T06:46:46.701 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-16T06:46:46.529863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592749,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109004,"kb_used_data":904,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377378356,"statfs":{"total":386547056640,"available":386435436544,"internally_reserved":0,"allocated":925696,"data_stored":1444894,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":6373,"internal_metadata":110618395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.748777"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380908+0000","last_change":"2024-09-16T06:46:39.197129+0000","last_active":"2024-09-16T06:46:39.380908+0000","last_peered":"2024-09-16T06:46:39.380908+0000","last_clean":"2024-09-16T06:46:39.380908+0000","last_became_active":"2024-09-16T06:46:39.196207+0000","last_became_peered":"2024-09-16T06:46:39.196207+0000","last_unstale":"2024-09-16T06:46:39.380908+0000","last_undegraded":"2024-09-16T06:46:39.380908+0000","last_fullsized":"2024-09-16T06:46:39.380908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:46.982408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374531+0000","last_change":"2024-09-16T06:46:39.181387+0000","last_active":"2024-09-16T06:46:39.374531+0000","last_peered":"2024-09-16T06:46:39.374531+0000","last_clean":"2024-09-16T06:46:39.374531+0000","last_became_active":"2024-09-16T06:46:39.181108+0000","last_became_peered":"2024-09-16T06:46:39.181108+0000","last_unstale":"2024-09-16T06:46:39.374531+0000","last_undegraded":"2024-09-16T06:46:39.374531+0000","last_fullsized":"2024-09-16T06:46:39.374531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:32:04.202458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374320+0000","last_change":"2024-09-16T06:46:39.183249+0000","last_active":"2024-09-16T06:46:39.374320+0000","last_peered":"2024-09-16T06:46:39.374320+0000","last_clean":"2024-09-16T06:46:39.374320+0000","last_became_active":"2024-09-16T06:46:39.181011+0000","last_became_peered":"2024-09-16T06:46:39.181011+0000","last_unstale":"2024-09-16T06:46:39.374320+0000","last_undegraded":"2024-09-16T06:46:39.374320+0000","last_fullsized":"2024-09-16T06:46:39.374320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:31.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574231+0000","last_change":"2024-09-16T06:46:39.200186+0000","last_active":"2024-09-16T06:46:39.574231+0000","last_peered":"2024-09-16T06:46:39.574231+0000","last_clean":"2024-09-16T06:46:39.574231+0000","last_became_active":"2024-09-16T06:46:39.199448+0000","last_became_peered":"2024-09-16T06:46:39.199448+0000","last_unstale":"2024-09-16T06:46:39.574231+0000","last_undegraded":"2024-09-16T06:46:39.574231+0000","last_fullsized":"2024-09-16T06:46:39.574231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380648+0000","last_change":"2024-09-16T06:46:39.178172+0000","last_active":"2024-09-16T06:46:39.380648+0000","last_peered":"2024-09-16T06:46:39.380648+0000","last_clean":"2024-09-16T06:46:39.380648+0000","last_became_active":"2024-09-16T06:46:39.177922+0000","last_became_peered":"2024-09-16T06:46:39.177922+0000","last_unstale":"2024-09-16T06:46:39.380648+0000","last_undegraded":"2024-09-16T06:46:39.380648+0000","last_fullsized":"2024-09-16T06:46:39.380648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379793+0000","last_change":"2024-09-16T06:46:39.174720+0000","last_active":"2024-09-16T06:46:39.379793+0000","last_peered":"2024-09-16T06:46:39.379793+0000","last_clean":"2024-09-16T06:46:39.379793+0000","last_became_active":"2024-09-16T06:46:39.173704+0000","last_became_peered":"2024-09-16T06:46:39.173704+0000","last_unstale":"2024-09-16T06:46:39.379793+0000","last_undegraded":"2024-09-16T06:46:39.379793+0000","last_fullsized":"2024-09-16T06:46:39.379793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:28:34.417850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379306+0000","last_change":"2024-09-16T06:46:39.190614+0000","last_active":"2024-09-16T06:46:39.379306+0000","last_peered":"2024-09-16T06:46:39.379306+0000","last_clean":"2024-09-16T06:46:39.379306+0000","last_became_active":"2024-09-16T06:46:39.179458+0000","last_became_peered":"2024-09-16T06:46:39.179458+0000","last_unstale":"2024-09-16T06:46:39.379306+0000","last_undegraded":"2024-09-16T06:46:39.379306+0000","last_fullsized":"2024-09-16T06:46:39.379306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:26:50.541794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373056+0000","last_change":"2024-09-16T06:46:39.185393+0000","last_active":"2024-09-16T06:46:39.373056+0000","last_peered":"2024-09-16T06:46:39.373056+0000","last_clean":"2024-09-16T06:46:39.373056+0000","last_became_active":"2024-09-16T06:46:39.185079+0000","last_became_peered":"2024-09-16T06:46:39.185079+0000","last_unstale":"2024-09-16T06:46:39.373056+0000","last_undegraded":"2024-09-16T06:46:39.373056+0000","last_fullsized":"2024-09-16T06:46:39.373056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380930+0000","last_change":"2024-09-16T06:46:39.197247+0000","last_active":"2024-09-16T06:46:39.380930+0000","last_peered":"2024-09-16T06:46:39.380930+0000","last_clean":"2024-09-16T06:46:39.380930+0000","last_became_active":"2024-09-16T06:46:39.196174+0000","last_became_peered":"2024-09-16T06:46:39.196174+0000","last_unstale":"2024-09-16T06:46:39.380930+0000","last_undegraded":"2024-09-16T06:46:39.380930+0000","last_fullsized":"2024-09-16T06:46:39.380930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:07.159072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574113+0000","last_change":"2024-09-16T06:46:39.193969+0000","last_active":"2024-09-16T06:46:39.574113+0000","last_peered":"2024-09-16T06:46:39.574113+0000","last_clean":"2024-09-16T06:46:39.574113+0000","last_became_active":"2024-09-16T06:46:39.192961+0000","last_became_peered":"2024-09-16T06:46:39.192961+0000","last_unstale":"2024-09-16T06:46:39.574113+0000","last_undegraded":"2024-09-16T06:46:39.574113+0000","last_fullsized":"2024-09-16T06:46:39.574113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573980+0000","last_change":"2024-09-16T06:46:39.184373+0000","last_active":"2024-09-16T06:46:39.573980+0000","last_peered":"2024-09-16T06:46:39.573980+0000","last_clean":"2024-09-16T06:46:39.573980+0000","last_became_active":"2024-09-16T06:46:39.184103+0000","last_became_peered":"2024-09-16T06:46:39.184103+0000","last_unstale":"2024-09-16T06:46:39.573980+0000","last_undegraded":"2024-09-16T06:46:39.573980+0000","last_fullsized":"2024-09-16T06:46:39.573980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:30.289208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380924+0000","last_change":"2024-09-16T06:46:39.191359+0000","last_active":"2024-09-16T06:46:39.380924+0000","last_peered":"2024-09-16T06:46:39.380924+0000","last_clean":"2024-09-16T06:46:39.380924+0000","last_became_active":"2024-09-16T06:46:39.190629+0000","last_became_peered":"2024-09-16T06:46:39.190629+0000","last_unstale":"2024-09-16T06:46:39.380924+0000","last_undegraded":"2024-09-16T06:46:39.380924+0000","last_fullsized":"2024-09-16T06:46:39.380924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:59.386136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379403+0000","last_change":"2024-09-16T06:46:39.197414+0000","last_active":"2024-09-16T06:46:39.379403+0000","last_peered":"2024-09-16T06:46:39.379403+0000","last_clean":"2024-09-16T06:46:39.379403+0000","last_became_active":"2024-09-16T06:46:39.196383+0000","last_became_peered":"2024-09-16T06:46:39.196383+0000","last_unstale":"2024-09-16T06:46:39.379403+0000","last_undegraded":"2024-09-16T06:46:39.379403+0000","last_fullsized":"2024-09-16T06:46:39.379403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:47.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373509+0000","last_change":"2024-09-16T06:46:39.186113+0000","last_active":"2024-09-16T06:46:39.373509+0000","last_peered":"2024-09-16T06:46:39.373509+0000","last_clean":"2024-09-16T06:46:39.373509+0000","last_became_active":"2024-09-16T06:46:39.185724+0000","last_became_peered":"2024-09-16T06:46:39.185724+0000","last_unstale":"2024-09-16T06:46:39.373509+0000","last_undegraded":"2024-09-16T06:46:39.373509+0000","last_fullsized":"2024-09-16T06:46:39.373509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373223+0000","last_change":"2024-09-16T06:46:39.181680+0000","last_active":"2024-09-16T06:46:39.373223+0000","last_peered":"2024-09-16T06:46:39.373223+0000","last_clean":"2024-09-16T06:46:39.373223+0000","last_became_active":"2024-09-16T06:46:39.181381+0000","last_became_peered":"2024-09-16T06:46:39.181381+0000","last_unstale":"2024-09-16T06:46:39.373223+0000","last_undegraded":"2024-09-16T06:46:39.373223+0000","last_fullsized":"2024-09-16T06:46:39.373223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:55.810363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373121+0000","last_change":"2024-09-16T06:46:39.183260+0000","last_active":"2024-09-16T06:46:39.373121+0000","last_peered":"2024-09-16T06:46:39.373121+0000","last_clean":"2024-09-16T06:46:39.373121+0000","last_became_active":"2024-09-16T06:46:39.182535+0000","last_became_peered":"2024-09-16T06:46:39.182535+0000","last_unstale":"2024-09-16T06:46:39.373121+0000","last_undegraded":"2024-09-16T06:46:39.373121+0000","last_fullsized":"2024-09-16T06:46:39.373121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574519+0000","last_change":"2024-09-16T06:46:39.196964+0000","last_active":"2024-09-16T06:46:39.574519+0000","last_peered":"2024-09-16T06:46:39.574519+0000","last_clean":"2024-09-16T06:46:39.574519+0000","last_became_active":"2024-09-16T06:46:39.193222+0000","last_became_peered":"2024-09-16T06:46:39.193222+0000","last_unstale":"2024-09-16T06:46:39.574519+0000","last_undegraded":"2024-09-16T06:46:39.574519+0000","last_fullsized":"2024-09-16T06:46:39.574519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382683+0000","last_change":"2024-09-16T06:46:39.195440+0000","last_active":"2024-09-16T06:46:39.382683+0000","last_peered":"2024-09-16T06:46:39.382683+0000","last_clean":"2024-09-16T06:46:39.382683+0000","last_became_active":"2024-09-16T06:46:39.195077+0000","last_became_peered":"2024-09-16T06:46:39.195077+0000","last_unstale":"2024-09-16T06:46:39.382683+0000","last_undegraded":"2024-09-16T06:46:39.382683+0000","last_fullsized":"2024-09-16T06:46:39.382683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:33.780991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380368+0000","last_change":"2024-09-16T06:46:39.199081+0000","last_active":"2024-09-16T06:46:39.380368+0000","last_peered":"2024-09-16T06:46:39.380368+0000","last_clean":"2024-09-16T06:46:39.380368+0000","last_became_active":"2024-09-16T06:46:39.198665+0000","last_became_peered":"2024-09-16T06:46:39.198665+0000","last_unstale":"2024-09-16T06:46:39.380368+0000","last_undegraded":"2024-09-16T06:46:39.380368+0000","last_fullsized":"2024-09-16T06:46:39.380368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:15.738622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574478+0000","last_change":"2024-09-16T06:46:39.189862+0000","last_active":"2024-09-16T06:46:39.574478+0000","last_peered":"2024-09-16T06:46:39.574478+0000","last_clean":"2024-09-16T06:46:39.574478+0000","last_became_active":"2024-09-16T06:46:39.189621+0000","last_became_peered":"2024-09-16T06:46:39.189621+0000","last_unstale":"2024-09-16T06:46:39.574478+0000","last_undegraded":"2024-09-16T06:46:39.574478+0000","last_fullsized":"2024-09-16T06:46:39.574478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374382+0000","last_change":"2024-09-16T06:46:39.166523+0000","last_active":"2024-09-16T06:46:39.374382+0000","last_peered":"2024-09-16T06:46:39.374382+0000","last_clean":"2024-09-16T06:46:39.374382+0000","last_became_active":"2024-09-16T06:46:39.166080+0000","last_became_peered":"2024-09-16T06:46:39.166080+0000","last_unstale":"2024-09-16T06:46:39.374382+0000","last_undegraded":"2024-09-16T06:46:39.374382+0000","last_fullsized":"2024-09-16T06:46:39.374382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572873+0000","last_change":"2024-09-16T06:46:39.192493+0000","last_active":"2024-09-16T06:46:39.572873+0000","last_peered":"2024-09-16T06:46:39.572873+0000","last_clean":"2024-09-16T06:46:39.572873+0000","last_became_active":"2024-09-16T06:46:39.191125+0000","last_became_peered":"2024-09-16T06:46:39.191125+0000","last_unstale":"2024-09-16T06:46:39.572873+0000","last_undegraded":"2024-09-16T06:46:39.572873+0000","last_fullsized":"2024-09-16T06:46:39.572873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:25:07.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379291+0000","last_change":"2024-09-16T06:46:39.201662+0000","last_active":"2024-09-16T06:46:39.379291+0000","last_peered":"2024-09-16T06:46:39.379291+0000","last_clean":"2024-09-16T06:46:39.379291+0000","last_became_active":"2024-09-16T06:46:39.201128+0000","last_became_peered":"2024-09-16T06:46:39.201128+0000","last_unstale":"2024-09-16T06:46:39.379291+0000","last_undegraded":"2024-09-16T06:46:39.379291+0000","last_fullsized":"2024-09-16T06:46:39.379291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373162+0000","last_change":"2024-09-16T06:46:39.165959+0000","last_active":"2024-09-16T06:46:39.373162+0000","last_peered":"2024-09-16T06:46:39.373162+0000","last_clean":"2024-09-16T06:46:39.373162+0000","last_became_active":"2024-09-16T06:46:39.165699+0000","last_became_peered":"2024-09-16T06:46:39.165699+0000","last_unstale":"2024-09-16T06:46:39.373162+0000","last_undegraded":"2024-09-16T06:46:39.373162+0000","last_fullsized":"2024-09-16T06:46:39.373162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574135+0000","last_change":"2024-09-16T06:46:39.192215+0000","last_active":"2024-09-16T06:46:39.574135+0000","last_peered":"2024-09-16T06:46:39.574135+0000","last_clean":"2024-09-16T06:46:39.574135+0000","last_became_active":"2024-09-16T06:46:39.190823+0000","last_became_peered":"2024-09-16T06:46:39.190823+0000","last_unstale":"2024-09-16T06:46:39.574135+0000","last_undegraded":"2024-09-16T06:46:39.574135+0000","last_fullsized":"2024-09-16T06:46:39.574135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:05.701061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574361+0000","last_change":"2024-09-16T06:46:39.191593+0000","last_active":"2024-09-16T06:46:39.574361+0000","last_peered":"2024-09-16T06:46:39.574361+0000","last_clean":"2024-09-16T06:46:39.574361+0000","last_became_active":"2024-09-16T06:46:39.191301+0000","last_became_peered":"2024-09-16T06:46:39.191301+0000","last_unstale":"2024-09-16T06:46:39.574361+0000","last_undegraded":"2024-09-16T06:46:39.574361+0000","last_fullsized":"2024-09-16T06:46:39.574361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374814+0000","last_change":"2024-09-16T06:46:39.166105+0000","last_active":"2024-09-16T06:46:39.374814+0000","last_peered":"2024-09-16T06:46:39.374814+0000","last_clean":"2024-09-16T06:46:39.374814+0000","last_became_active":"2024-09-16T06:46:39.165575+0000","last_became_peered":"2024-09-16T06:46:39.165575+0000","last_unstale":"2024-09-16T06:46:39.374814+0000","last_undegraded":"2024-09-16T06:46:39.374814+0000","last_fullsized":"2024-09-16T06:46:39.374814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575020+0000","last_change":"2024-09-16T06:46:39.191790+0000","last_active":"2024-09-16T06:46:39.575020+0000","last_peered":"2024-09-16T06:46:39.575020+0000","last_clean":"2024-09-16T06:46:39.575020+0000","last_became_active":"2024-09-16T06:46:39.191549+0000","last_became_peered":"2024-09-16T06:46:39.191549+0000","last_unstale":"2024-09-16T06:46:39.575020+0000","last_undegraded":"2024-09-16T06:46:39.575020+0000","last_fullsized":"2024-09-16T06:46:39.575020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380372+0000","last_change":"2024-09-16T06:46:39.176484+0000","last_active":"2024-09-16T06:46:39.380372+0000","last_peered":"2024-09-16T06:46:39.380372+0000","last_clean":"2024-09-16T06:46:39.380372+0000","last_became_active":"2024-09-16T06:46:39.176214+0000","last_became_peered":"2024-09-16T06:46:39.176214+0000","last_unstale":"2024-09-16T06:46:39.380372+0000","last_undegraded":"2024-09-16T06:46:39.380372+0000","last_fullsized":"2024-09-16T06:46:39.380372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573144+0000","last_change":"2024-09-16T06:46:39.188928+0000","last_active":"2024-09-16T06:46:39.573144+0000","last_peered":"2024-09-16T06:46:39.573144+0000","last_clean":"2024-09-16T06:46:39.573144+0000","last_became_active":"2024-09-16T06:46:39.188620+0000","last_became_peered":"2024-09-16T06:46:39.188620+0000","last_unstale":"2024-09-16T06:46:39.573144+0000","last_undegraded":"2024-09-16T06:46:39.573144+0000","last_fullsized":"2024-09-16T06:46:39.573144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379459+0000","last_change":"2024-09-16T06:46:39.200952+0000","last_active":"2024-09-16T06:46:39.379459+0000","last_peered":"2024-09-16T06:46:39.379459+0000","last_clean":"2024-09-16T06:46:39.379459+0000","last_became_active":"2024-09-16T06:46:39.197413+0000","last_became_peered":"2024-09-16T06:46:39.197413+0000","last_unstale":"2024-09-16T06:46:39.379459+0000","last_undegraded":"2024-09-16T06:46:39.379459+0000","last_fullsized":"2024-09-16T06:46:39.379459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373219+0000","last_change":"2024-09-16T06:46:39.183560+0000","last_active":"2024-09-16T06:46:39.373219+0000","last_peered":"2024-09-16T06:46:39.373219+0000","last_clean":"2024-09-16T06:46:39.373219+0000","last_became_active":"2024-09-16T06:46:39.182899+0000","last_became_peered":"2024-09-16T06:46:39.182899+0000","last_unstale":"2024-09-16T06:46:39.373219+0000","last_undegraded":"2024-09-16T06:46:39.373219+0000","last_fullsized":"2024-09-16T06:46:39.373219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:35:23.063466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381984+0000","last_change":"2024-09-16T06:46:39.200486+0000","last_active":"2024-09-16T06:46:39.381984+0000","last_peered":"2024-09-16T06:46:39.381984+0000","last_clean":"2024-09-16T06:46:39.381984+0000","last_became_active":"2024-09-16T06:46:39.198054+0000","last_became_peered":"2024-09-16T06:46:39.198054+0000","last_unstale":"2024-09-16T06:46:39.381984+0000","last_undegraded":"2024-09-16T06:46:39.381984+0000","last_fullsized":"2024-09-16T06:46:39.381984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381262+0000","last_change":"2024-09-16T06:46:38.819482+0000","last_active":"2024-09-16T06:46:39.381262+0000","last_peered":"2024-09-16T06:46:39.381262+0000","last_clean":"2024-09-16T06:46:39.381262+0000","last_became_active":"2024-09-16T06:46:38.818284+0000","last_became_peered":"2024-09-16T06:46:38.818284+0000","last_unstale":"2024-09-16T06:46:39.381262+0000","last_undegraded":"2024-09-16T06:46:39.381262+0000","last_fullsized":"2024-09-16T06:46:39.381262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:20.195598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382318+0000","last_change":"2024-09-16T06:46:39.195870+0000","last_active":"2024-09-16T06:46:39.382318+0000","last_peered":"2024-09-16T06:46:39.382318+0000","last_clean":"2024-09-16T06:46:39.382318+0000","last_became_active":"2024-09-16T06:46:39.194071+0000","last_became_peered":"2024-09-16T06:46:39.194071+0000","last_unstale":"2024-09-16T06:46:39.382318+0000","last_undegraded":"2024-09-16T06:46:39.382318+0000","last_fullsized":"2024-09-16T06:46:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:53.619215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380249+0000","last_change":"2024-09-16T06:46:38.827083+0000","last_active":"2024-09-16T06:46:39.380249+0000","last_peered":"2024-09-16T06:46:39.380249+0000","last_clean":"2024-09-16T06:46:39.380249+0000","last_became_active":"2024-09-16T06:46:38.826329+0000","last_became_peered":"2024-09-16T06:46:38.826329+0000","last_unstale":"2024-09-16T06:46:39.380249+0000","last_undegraded":"2024-09-16T06:46:39.380249+0000","last_fullsized":"2024-09-16T06:46:39.380249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:23.891217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382370+0000","last_change":"2024-09-16T06:46:39.200568+0000","last_active":"2024-09-16T06:46:39.382370+0000","last_peered":"2024-09-16T06:46:39.382370+0000","last_clean":"2024-09-16T06:46:39.382370+0000","last_became_active":"2024-09-16T06:46:39.197902+0000","last_became_peered":"2024-09-16T06:46:39.197902+0000","last_unstale":"2024-09-16T06:46:39.382370+0000","last_undegraded":"2024-09-16T06:46:39.382370+0000","last_fullsized":"2024-09-16T06:46:39.382370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373400+0000","last_change":"2024-09-16T06:46:38.831919+0000","last_active":"2024-09-16T06:46:39.373400+0000","last_peered":"2024-09-16T06:46:39.373400+0000","last_clean":"2024-09-16T06:46:39.373400+0000","last_became_active":"2024-09-16T06:46:38.831609+0000","last_became_peered":"2024-09-16T06:46:38.831609+0000","last_unstale":"2024-09-16T06:46:39.373400+0000","last_undegraded":"2024-09-16T06:46:39.373400+0000","last_fullsized":"2024-09-16T06:46:39.373400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382988+0000","last_change":"2024-09-16T06:46:39.200573+0000","last_active":"2024-09-16T06:46:39.382988+0000","last_peered":"2024-09-16T06:46:39.382988+0000","last_clean":"2024-09-16T06:46:39.382988+0000","last_became_active":"2024-09-16T06:46:39.198472+0000","last_became_peered":"2024-09-16T06:46:39.198472+0000","last_unstale":"2024-09-16T06:46:39.382988+0000","last_undegraded":"2024-09-16T06:46:39.382988+0000","last_fullsized":"2024-09-16T06:46:39.382988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373251+0000","last_change":"2024-09-16T06:46:38.827569+0000","last_active":"2024-09-16T06:46:39.373251+0000","last_peered":"2024-09-16T06:46:39.373251+0000","last_clean":"2024-09-16T06:46:39.373251+0000","last_became_active":"2024-09-16T06:46:38.827207+0000","last_became_peered":"2024-09-16T06:46:38.827207+0000","last_unstale":"2024-09-16T06:46:39.373251+0000","last_undegraded":"2024-09-16T06:46:39.373251+0000","last_fullsized":"2024-09-16T06:46:39.373251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:03.087447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374993+0000","last_change":"2024-09-16T06:46:38.838219+0000","last_active":"2024-09-16T06:46:39.374993+0000","last_peered":"2024-09-16T06:46:39.374993+0000","last_clean":"2024-09-16T06:46:39.374993+0000","last_became_active":"2024-09-16T06:46:38.837847+0000","last_became_peered":"2024-09-16T06:46:38.837847+0000","last_unstale":"2024-09-16T06:46:39.374993+0000","last_undegraded":"2024-09-16T06:46:39.374993+0000","last_fullsized":"2024-09-16T06:46:39.374993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:13:29.278281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379022+0000","last_change":"2024-09-16T06:46:39.178965+0000","last_active":"2024-09-16T06:46:39.379022+0000","last_peered":"2024-09-16T06:46:39.379022+0000","last_clean":"2024-09-16T06:46:39.379022+0000","last_became_active":"2024-09-16T06:46:39.178626+0000","last_became_peered":"2024-09-16T06:46:39.178626+0000","last_unstale":"2024-09-16T06:46:39.379022+0000","last_undegraded":"2024-09-16T06:46:39.379022+0000","last_fullsized":"2024-09-16T06:46:39.379022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:07.184854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374813+0000","last_change":"2024-09-16T06:46:38.810716+0000","last_active":"2024-09-16T06:46:39.374813+0000","last_peered":"2024-09-16T06:46:39.374813+0000","last_clean":"2024-09-16T06:46:39.374813+0000","last_became_active":"2024-09-16T06:46:38.810300+0000","last_became_peered":"2024-09-16T06:46:38.810300+0000","last_unstale":"2024-09-16T06:46:39.374813+0000","last_undegraded":"2024-09-16T06:46:39.374813+0000","last_fullsized":"2024-09-16T06:46:39.374813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:28:45.971482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573028+0000","last_change":"2024-09-16T06:46:39.200612+0000","last_active":"2024-09-16T06:46:39.573028+0000","last_peered":"2024-09-16T06:46:39.573028+0000","last_clean":"2024-09-16T06:46:39.573028+0000","last_became_active":"2024-09-16T06:46:39.200182+0000","last_became_peered":"2024-09-16T06:46:39.200182+0000","last_unstale":"2024-09-16T06:46:39.573028+0000","last_undegraded":"2024-09-16T06:46:39.573028+0000","last_fullsized":"2024-09-16T06:46:39.573028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:39:54.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374666+0000","last_change":"2024-09-16T06:46:38.828295+0000","last_active":"2024-09-16T06:46:39.374666+0000","last_peered":"2024-09-16T06:46:39.374666+0000","last_clean":"2024-09-16T06:46:39.374666+0000","last_became_active":"2024-09-16T06:46:38.827978+0000","last_became_peered":"2024-09-16T06:46:38.827978+0000","last_unstale":"2024-09-16T06:46:39.374666+0000","last_undegraded":"2024-09-16T06:46:39.374666+0000","last_fullsized":"2024-09-16T06:46:39.374666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:41.144933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373659+0000","last_change":"2024-09-16T06:46:39.165852+0000","last_active":"2024-09-16T06:46:39.373659+0000","last_peered":"2024-09-16T06:46:39.373659+0000","last_clean":"2024-09-16T06:46:39.373659+0000","last_became_active":"2024-09-16T06:46:39.165606+0000","last_became_peered":"2024-09-16T06:46:39.165606+0000","last_unstale":"2024-09-16T06:46:39.373659+0000","last_undegraded":"2024-09-16T06:46:39.373659+0000","last_fullsized":"2024-09-16T06:46:39.373659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:18:43.761279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374787+0000","last_change":"2024-09-16T06:46:38.791462+0000","last_active":"2024-09-16T06:46:39.374787+0000","last_peered":"2024-09-16T06:46:39.374787+0000","last_clean":"2024-09-16T06:46:39.374787+0000","last_became_active":"2024-09-16T06:46:38.790888+0000","last_became_peered":"2024-09-16T06:46:38.790888+0000","last_unstale":"2024-09-16T06:46:39.374787+0000","last_undegraded":"2024-09-16T06:46:39.374787+0000","last_fullsized":"2024-09-16T06:46:39.374787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380151+0000","last_change":"2024-09-16T06:46:39.194753+0000","last_active":"2024-09-16T06:46:39.380151+0000","last_peered":"2024-09-16T06:46:39.380151+0000","last_clean":"2024-09-16T06:46:39.380151+0000","last_became_active":"2024-09-16T06:46:39.194441+0000","last_became_peered":"2024-09-16T06:46:39.194441+0000","last_unstale":"2024-09-16T06:46:39.380151+0000","last_undegraded":"2024-09-16T06:46:39.380151+0000","last_fullsized":"2024-09-16T06:46:39.380151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:10.938486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381628+0000","last_change":"2024-09-16T06:46:38.828919+0000","last_active":"2024-09-16T06:46:39.381628+0000","last_peered":"2024-09-16T06:46:39.381628+0000","last_clean":"2024-09-16T06:46:39.381628+0000","last_became_active":"2024-09-16T06:46:38.827632+0000","last_became_peered":"2024-09-16T06:46:38.827632+0000","last_unstale":"2024-09-16T06:46:39.381628+0000","last_undegraded":"2024-09-16T06:46:39.381628+0000","last_fullsized":"2024-09-16T06:46:39.381628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574796+0000","last_change":"2024-09-16T06:46:39.199721+0000","last_active":"2024-09-16T06:46:39.574796+0000","last_peered":"2024-09-16T06:46:39.574796+0000","last_clean":"2024-09-16T06:46:39.574796+0000","last_became_active":"2024-09-16T06:46:39.198781+0000","last_became_peered":"2024-09-16T06:46:39.198781+0000","last_unstale":"2024-09-16T06:46:39.574796+0000","last_undegraded":"2024-09-16T06:46:39.574796+0000","last_fullsized":"2024-09-16T06:46:39.574796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:31.253728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373852+0000","last_change":"2024-09-16T06:46:38.827548+0000","last_active":"2024-09-16T06:46:39.373852+0000","last_peered":"2024-09-16T06:46:39.373852+0000","last_clean":"2024-09-16T06:46:39.373852+0000","last_became_active":"2024-09-16T06:46:38.827223+0000","last_became_peered":"2024-09-16T06:46:38.827223+0000","last_unstale":"2024-09-16T06:46:39.373852+0000","last_undegraded":"2024-09-16T06:46:39.373852+0000","last_fullsized":"2024-09-16T06:46:39.373852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:24.775378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374413+0000","last_change":"2024-09-16T06:46:39.182960+0000","last_active":"2024-09-16T06:46:39.374413+0000","last_peered":"2024-09-16T06:46:39.374413+0000","last_clean":"2024-09-16T06:46:39.374413+0000","last_became_active":"2024-09-16T06:46:39.182729+0000","last_became_peered":"2024-09-16T06:46:39.182729+0000","last_unstale":"2024-09-16T06:46:39.374413+0000","last_undegraded":"2024-09-16T06:46:39.374413+0000","last_fullsized":"2024-09-16T06:46:39.374413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:20.658262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379585+0000","last_change":"2024-09-16T06:46:38.828147+0000","last_active":"2024-09-16T06:46:39.379585+0000","last_peered":"2024-09-16T06:46:39.379585+0000","last_clean":"2024-09-16T06:46:39.379585+0000","last_became_active":"2024-09-16T06:46:38.810187+0000","last_became_peered":"2024-09-16T06:46:38.810187+0000","last_unstale":"2024-09-16T06:46:39.379585+0000","last_undegraded":"2024-09-16T06:46:39.379585+0000","last_fullsized":"2024-09-16T06:46:39.379585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:49.449347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380665+0000","last_change":"2024-09-16T06:46:39.188782+0000","last_active":"2024-09-16T06:46:39.380665+0000","last_peered":"2024-09-16T06:46:39.380665+0000","last_clean":"2024-09-16T06:46:39.380665+0000","last_became_active":"2024-09-16T06:46:39.188111+0000","last_became_peered":"2024-09-16T06:46:39.188111+0000","last_unstale":"2024-09-16T06:46:39.380665+0000","last_undegraded":"2024-09-16T06:46:39.380665+0000","last_fullsized":"2024-09-16T06:46:39.380665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:42.155860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379176+0000","last_change":"2024-09-16T06:46:38.843585+0000","last_active":"2024-09-16T06:46:39.379176+0000","last_peered":"2024-09-16T06:46:39.379176+0000","last_clean":"2024-09-16T06:46:39.379176+0000","last_became_active":"2024-09-16T06:46:38.842948+0000","last_became_peered":"2024-09-16T06:46:38.842948+0000","last_unstale":"2024-09-16T06:46:39.379176+0000","last_undegraded":"2024-09-16T06:46:39.379176+0000","last_fullsized":"2024-09-16T06:46:39.379176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:35.981497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574259+0000","last_change":"2024-09-16T06:46:39.205252+0000","last_active":"2024-09-16T06:46:39.574259+0000","last_peered":"2024-09-16T06:46:39.574259+0000","last_clean":"2024-09-16T06:46:39.574259+0000","last_became_active":"2024-09-16T06:46:39.204938+0000","last_became_peered":"2024-09-16T06:46:39.204938+0000","last_unstale":"2024-09-16T06:46:39.574259+0000","last_undegraded":"2024-09-16T06:46:39.574259+0000","last_fullsized":"2024-09-16T06:46:39.574259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:35.285505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.172541+0000","last_change":"2024-09-16T06:46:28.420745+0000","last_active":"2024-09-16T06:46:39.172541+0000","last_peered":"2024-09-16T06:46:39.172541+0000","last_clean":"2024-09-16T06:46:39.172541+0000","last_became_active":"2024-09-16T06:46:28.419090+0000","last_became_peered":"2024-09-16T06:46:28.419090+0000","last_unstale":"2024-09-16T06:46:39.172541+0000","last_undegraded":"2024-09-16T06:46:39.172541+0000","last_fullsized":"2024-09-16T06:46:39.172541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:27.264921+0000","last_clean_scrub_stamp":"2024-09-16T06:46:27.264921+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:28:51.531389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374566+0000","last_change":"2024-09-16T06:46:34.591498+0000","last_active":"2024-09-16T06:46:39.374566+0000","last_peered":"2024-09-16T06:46:39.374566+0000","last_clean":"2024-09-16T06:46:39.374566+0000","last_became_active":"2024-09-16T06:46:32.591383+0000","last_became_peered":"2024-09-16T06:46:32.591383+0000","last_unstale":"2024-09-16T06:46:39.374566+0000","last_undegraded":"2024-09-16T06:46:39.374566+0000","last_fullsized":"2024-09-16T06:46:39.374566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:53.253566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010025520000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380170+0000","last_change":"2024-09-16T06:46:38.820440+0000","last_active":"2024-09-16T06:46:39.380170+0000","last_peered":"2024-09-16T06:46:39.380170+0000","last_clean":"2024-09-16T06:46:39.380170+0000","last_became_active":"2024-09-16T06:46:38.818437+0000","last_became_peered":"2024-09-16T06:46:38.818437+0000","last_unstale":"2024-09-16T06:46:39.380170+0000","last_undegraded":"2024-09-16T06:46:39.380170+0000","last_fullsized":"2024-09-16T06:46:39.380170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:04.350191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374591+0000","last_change":"2024-09-16T06:46:39.182247+0000","last_active":"2024-09-16T06:46:39.374591+0000","last_peered":"2024-09-16T06:46:39.374591+0000","last_clean":"2024-09-16T06:46:39.374591+0000","last_became_active":"2024-09-16T06:46:39.181061+0000","last_became_peered":"2024-09-16T06:46:39.181061+0000","last_unstale":"2024-09-16T06:46:39.374591+0000","last_undegraded":"2024-09-16T06:46:39.374591+0000","last_fullsized":"2024-09-16T06:46:39.374591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:38:11.090727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373360+0000","last_change":"2024-09-16T06:46:34.591483+0000","last_active":"2024-09-16T06:46:39.373360+0000","last_peered":"2024-09-16T06:46:39.373360+0000","last_clean":"2024-09-16T06:46:39.373360+0000","last_became_active":"2024-09-16T06:46:32.587817+0000","last_became_peered":"2024-09-16T06:46:32.587817+0000","last_unstale":"2024-09-16T06:46:39.373360+0000","last_undegraded":"2024-09-16T06:46:39.373360+0000","last_fullsized":"2024-09-16T06:46:39.373360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010582059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573485+0000","last_change":"2024-09-16T06:46:38.837265+0000","last_active":"2024-09-16T06:46:39.573485+0000","last_peered":"2024-09-16T06:46:39.573485+0000","last_clean":"2024-09-16T06:46:39.573485+0000","last_became_active":"2024-09-16T06:46:38.832115+0000","last_became_peered":"2024-09-16T06:46:38.832115+0000","last_unstale":"2024-09-16T06:46:39.573485+0000","last_undegraded":"2024-09-16T06:46:39.573485+0000","last_fullsized":"2024-09-16T06:46:39.573485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:06.148145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382717+0000","last_change":"2024-09-16T06:46:39.200924+0000","last_active":"2024-09-16T06:46:39.382717+0000","last_peered":"2024-09-16T06:46:39.382717+0000","last_clean":"2024-09-16T06:46:39.382717+0000","last_became_active":"2024-09-16T06:46:39.200607+0000","last_became_peered":"2024-09-16T06:46:39.200607+0000","last_unstale":"2024-09-16T06:46:39.382717+0000","last_undegraded":"2024-09-16T06:46:39.382717+0000","last_fullsized":"2024-09-16T06:46:39.382717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:26:44.837664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379692+0000","last_change":"2024-09-16T06:46:34.715640+0000","last_active":"2024-09-16T06:46:39.379692+0000","last_peered":"2024-09-16T06:46:39.379692+0000","last_clean":"2024-09-16T06:46:39.379692+0000","last_became_active":"2024-09-16T06:46:32.593992+0000","last_became_peered":"2024-09-16T06:46:32.593992+0000","last_unstale":"2024-09-16T06:46:39.379692+0000","last_undegraded":"2024-09-16T06:46:39.379692+0000","last_fullsized":"2024-09-16T06:46:39.379692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:30.696024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051250899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572853+0000","last_change":"2024-09-16T06:46:38.831231+0000","last_active":"2024-09-16T06:46:39.572853+0000","last_peered":"2024-09-16T06:46:39.572853+0000","last_clean":"2024-09-16T06:46:39.572853+0000","last_became_active":"2024-09-16T06:46:38.830405+0000","last_became_peered":"2024-09-16T06:46:38.830405+0000","last_unstale":"2024-09-16T06:46:39.572853+0000","last_undegraded":"2024-09-16T06:46:39.572853+0000","last_fullsized":"2024-09-16T06:46:39.572853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:41.881677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574391+0000","last_change":"2024-09-16T06:46:39.199732+0000","last_active":"2024-09-16T06:46:39.574391+0000","last_peered":"2024-09-16T06:46:39.574391+0000","last_clean":"2024-09-16T06:46:39.574391+0000","last_became_active":"2024-09-16T06:46:39.199407+0000","last_became_peered":"2024-09-16T06:46:39.199407+0000","last_unstale":"2024-09-16T06:46:39.574391+0000","last_undegraded":"2024-09-16T06:46:39.574391+0000","last_fullsized":"2024-09-16T06:46:39.574391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:51:39.844224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373924+0000","last_change":"2024-09-16T06:46:34.592232+0000","last_active":"2024-09-16T06:46:39.373924+0000","last_peered":"2024-09-16T06:46:39.373924+0000","last_clean":"2024-09-16T06:46:39.373924+0000","last_became_active":"2024-09-16T06:46:32.584409+0000","last_became_peered":"2024-09-16T06:46:32.584409+0000","last_unstale":"2024-09-16T06:46:39.373924+0000","last_undegraded":"2024-09-16T06:46:39.373924+0000","last_fullsized":"2024-09-16T06:46:39.373924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001754603,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374471+0000","last_change":"2024-09-16T06:46:38.815767+0000","last_active":"2024-09-16T06:46:39.374471+0000","last_peered":"2024-09-16T06:46:39.374471+0000","last_clean":"2024-09-16T06:46:39.374471+0000","last_became_active":"2024-09-16T06:46:38.815553+0000","last_became_peered":"2024-09-16T06:46:38.815553+0000","last_unstale":"2024-09-16T06:46:39.374471+0000","last_undegraded":"2024-09-16T06:46:39.374471+0000","last_fullsized":"2024-09-16T06:46:39.374471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:13:03.610912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574733+0000","last_change":"2024-09-16T06:46:39.194564+0000","last_active":"2024-09-16T06:46:39.574733+0000","last_peered":"2024-09-16T06:46:39.574733+0000","last_clean":"2024-09-16T06:46:39.574733+0000","last_became_active":"2024-09-16T06:46:39.194168+0000","last_became_peered":"2024-09-16T06:46:39.194168+0000","last_unstale":"2024-09-16T06:46:39.574733+0000","last_undegraded":"2024-09-16T06:46:39.574733+0000","last_fullsized":"2024-09-16T06:46:39.574733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:00.037107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374696+0000","last_change":"2024-09-16T06:46:38.828799+0000","last_active":"2024-09-16T06:46:39.374696+0000","last_peered":"2024-09-16T06:46:39.374696+0000","last_clean":"2024-09-16T06:46:39.374696+0000","last_became_active":"2024-09-16T06:46:38.828136+0000","last_became_peered":"2024-09-16T06:46:38.828136+0000","last_unstale":"2024-09-16T06:46:39.374696+0000","last_undegraded":"2024-09-16T06:46:39.374696+0000","last_fullsized":"2024-09-16T06:46:39.374696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:33.286790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575150+0000","last_change":"2024-09-16T06:46:34.595510+0000","last_active":"2024-09-16T06:46:39.575150+0000","last_peered":"2024-09-16T06:46:39.575150+0000","last_clean":"2024-09-16T06:46:39.575150+0000","last_became_active":"2024-09-16T06:46:32.588966+0000","last_became_peered":"2024-09-16T06:46:32.588966+0000","last_unstale":"2024-09-16T06:46:39.575150+0000","last_undegraded":"2024-09-16T06:46:39.575150+0000","last_fullsized":"2024-09-16T06:46:39.575150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:19.698982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082793000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.572993+0000","last_change":"2024-09-16T06:46:39.192738+0000","last_active":"2024-09-16T06:46:39.572993+0000","last_peered":"2024-09-16T06:46:39.572993+0000","last_clean":"2024-09-16T06:46:39.572993+0000","last_became_active":"2024-09-16T06:46:39.192227+0000","last_became_peered":"2024-09-16T06:46:39.192227+0000","last_unstale":"2024-09-16T06:46:39.572993+0000","last_undegraded":"2024-09-16T06:46:39.572993+0000","last_fullsized":"2024-09-16T06:46:39.572993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:40.370400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.575058+0000","last_change":"2024-09-16T06:46:38.836459+0000","last_active":"2024-09-16T06:46:39.575058+0000","last_peered":"2024-09-16T06:46:39.575058+0000","last_clean":"2024-09-16T06:46:39.575058+0000","last_became_active":"2024-09-16T06:46:38.832248+0000","last_became_peered":"2024-09-16T06:46:38.832248+0000","last_unstale":"2024-09-16T06:46:39.575058+0000","last_undegraded":"2024-09-16T06:46:39.575058+0000","last_fullsized":"2024-09-16T06:46:39.575058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:56.866622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374900+0000","last_change":"2024-09-16T06:46:34.592592+0000","last_active":"2024-09-16T06:46:39.374900+0000","last_peered":"2024-09-16T06:46:39.374900+0000","last_clean":"2024-09-16T06:46:39.374900+0000","last_became_active":"2024-09-16T06:46:32.591488+0000","last_became_peered":"2024-09-16T06:46:32.591488+0000","last_unstale":"2024-09-16T06:46:39.374900+0000","last_undegraded":"2024-09-16T06:46:39.374900+0000","last_fullsized":"2024-09-16T06:46:39.374900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:46:25.248987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018038799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573210+0000","last_change":"2024-09-16T06:46:39.193260+0000","last_active":"2024-09-16T06:46:39.573210+0000","last_peered":"2024-09-16T06:46:39.573210+0000","last_clean":"2024-09-16T06:46:39.573210+0000","last_became_active":"2024-09-16T06:46:39.192979+0000","last_became_peered":"2024-09-16T06:46:39.192979+0000","last_unstale":"2024-09-16T06:46:39.573210+0000","last_undegraded":"2024-09-16T06:46:39.573210+0000","last_fullsized":"2024-09-16T06:46:39.573210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:44.340564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.383066+0000","last_change":"2024-09-16T06:46:38.843068+0000","last_active":"2024-09-16T06:46:39.383066+0000","last_peered":"2024-09-16T06:46:39.383066+0000","last_clean":"2024-09-16T06:46:39.383066+0000","last_became_active":"2024-09-16T06:46:38.842540+0000","last_became_peered":"2024-09-16T06:46:38.842540+0000","last_unstale":"2024-09-16T06:46:39.383066+0000","last_undegraded":"2024-09-16T06:46:39.383066+0000","last_fullsized":"2024-09-16T06:46:39.383066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574707+0000","last_change":"2024-09-16T06:46:34.595534+0000","last_active":"2024-09-16T06:46:39.574707+0000","last_peered":"2024-09-16T06:46:39.574707+0000","last_clean":"2024-09-16T06:46:39.574707+0000","last_became_active":"2024-09-16T06:46:32.591633+0000","last_became_peered":"2024-09-16T06:46:32.591633+0000","last_unstale":"2024-09-16T06:46:39.574707+0000","last_undegraded":"2024-09-16T06:46:39.574707+0000","last_fullsized":"2024-09-16T06:46:39.574707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:21:36.277892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084554300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379049+0000","last_change":"2024-09-16T06:46:39.198185+0000","last_active":"2024-09-16T06:46:39.379049+0000","last_peered":"2024-09-16T06:46:39.379049+0000","last_clean":"2024-09-16T06:46:39.379049+0000","last_became_active":"2024-09-16T06:46:39.197829+0000","last_became_peered":"2024-09-16T06:46:39.197829+0000","last_unstale":"2024-09-16T06:46:39.379049+0000","last_undegraded":"2024-09-16T06:46:39.379049+0000","last_fullsized":"2024-09-16T06:46:39.379049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.768079+0000","last_change":"2024-09-16T06:46:38.824771+0000","last_active":"2024-09-16T06:46:39.768079+0000","last_peered":"2024-09-16T06:46:39.768079+0000","last_clean":"2024-09-16T06:46:39.768079+0000","last_became_active":"2024-09-16T06:46:38.824096+0000","last_became_peered":"2024-09-16T06:46:38.824096+0000","last_unstale":"2024-09-16T06:46:39.768079+0000","last_undegraded":"2024-09-16T06:46:39.768079+0000","last_fullsized":"2024-09-16T06:46:39.768079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:44.556512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.375046+0000","last_change":"2024-09-16T06:46:34.592095+0000","last_active":"2024-09-16T06:46:39.375046+0000","last_peered":"2024-09-16T06:46:39.375046+0000","last_clean":"2024-09-16T06:46:39.375046+0000","last_became_active":"2024-09-16T06:46:32.585129+0000","last_became_peered":"2024-09-16T06:46:32.585129+0000","last_unstale":"2024-09-16T06:46:39.375046+0000","last_undegraded":"2024-09-16T06:46:39.375046+0000","last_fullsized":"2024-09-16T06:46:39.375046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:31.565635+0000","last_clean_scrub_stamp":"2024-09-16T06:46:31.565635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:55.521712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015900179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379347+0000","last_change":"2024-09-16T06:46:39.187196+0000","last_active":"2024-09-16T06:46:39.379347+0000","last_peered":"2024-09-16T06:46:39.379347+0000","last_clean":"2024-09-16T06:46:39.379347+0000","last_became_active":"2024-09-16T06:46:39.184981+0000","last_became_peered":"2024-09-16T06:46:39.184981+0000","last_unstale":"2024-09-16T06:46:39.379347+0000","last_undegraded":"2024-09-16T06:46:39.379347+0000","last_fullsized":"2024-09-16T06:46:39.379347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:03:34.297717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379916+0000","last_change":"2024-09-16T06:46:39.185361+0000","last_active":"2024-09-16T06:46:39.379916+0000","last_peered":"2024-09-16T06:46:39.379916+0000","last_clean":"2024-09-16T06:46:39.379916+0000","last_became_active":"2024-09-16T06:46:39.185017+0000","last_became_peered":"2024-09-16T06:46:39.185017+0000","last_unstale":"2024-09-16T06:46:39.379916+0000","last_undegraded":"2024-09-16T06:46:39.379916+0000","last_fullsized":"2024-09-16T06:46:39.379916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:57.877549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374658+0000","last_change":"2024-09-16T06:46:38.804787+0000","last_active":"2024-09-16T06:46:39.374658+0000","last_peered":"2024-09-16T06:46:39.374658+0000","last_clean":"2024-09-16T06:46:39.374658+0000","last_became_active":"2024-09-16T06:46:38.804503+0000","last_became_peered":"2024-09-16T06:46:38.804503+0000","last_unstale":"2024-09-16T06:46:39.374658+0000","last_undegraded":"2024-09-16T06:46:39.374658+0000","last_fullsized":"2024-09-16T06:46:39.374658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:37:58.375210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573446+0000","last_change":"2024-09-16T06:46:39.185466+0000","last_active":"2024-09-16T06:46:39.573446+0000","last_peered":"2024-09-16T06:46:39.573446+0000","last_clean":"2024-09-16T06:46:39.573446+0000","last_became_active":"2024-09-16T06:46:39.185188+0000","last_became_peered":"2024-09-16T06:46:39.185188+0000","last_unstale":"2024-09-16T06:46:39.573446+0000","last_undegraded":"2024-09-16T06:46:39.573446+0000","last_fullsized":"2024-09-16T06:46:39.573446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:46.113123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.381315+0000","last_change":"2024-09-16T06:46:38.826430+0000","last_active":"2024-09-16T06:46:39.381315+0000","last_peered":"2024-09-16T06:46:39.381315+0000","last_clean":"2024-09-16T06:46:39.381315+0000","last_became_active":"2024-09-16T06:46:38.825763+0000","last_became_peered":"2024-09-16T06:46:38.825763+0000","last_unstale":"2024-09-16T06:46:39.381315+0000","last_undegraded":"2024-09-16T06:46:39.381315+0000","last_fullsized":"2024-09-16T06:46:39.381315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:55.060544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374601+0000","last_change":"2024-09-16T06:46:38.828786+0000","last_active":"2024-09-16T06:46:39.374601+0000","last_peered":"2024-09-16T06:46:39.374601+0000","last_clean":"2024-09-16T06:46:39.374601+0000","last_became_active":"2024-09-16T06:46:38.827157+0000","last_became_peered":"2024-09-16T06:46:38.827157+0000","last_unstale":"2024-09-16T06:46:39.374601+0000","last_undegraded":"2024-09-16T06:46:39.374601+0000","last_fullsized":"2024-09-16T06:46:39.374601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:10:03.077384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379573+0000","last_change":"2024-09-16T06:46:39.195693+0000","last_active":"2024-09-16T06:46:39.379573+0000","last_peered":"2024-09-16T06:46:39.379573+0000","last_clean":"2024-09-16T06:46:39.379573+0000","last_became_active":"2024-09-16T06:46:39.180517+0000","last_became_peered":"2024-09-16T06:46:39.180517+0000","last_unstale":"2024-09-16T06:46:39.379573+0000","last_undegraded":"2024-09-16T06:46:39.379573+0000","last_fullsized":"2024-09-16T06:46:39.379573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:16.222534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574953+0000","last_change":"2024-09-16T06:46:38.842337+0000","last_active":"2024-09-16T06:46:39.574953+0000","last_peered":"2024-09-16T06:46:39.574953+0000","last_clean":"2024-09-16T06:46:39.574953+0000","last_became_active":"2024-09-16T06:46:38.841847+0000","last_became_peered":"2024-09-16T06:46:38.841847+0000","last_unstale":"2024-09-16T06:46:39.574953+0000","last_undegraded":"2024-09-16T06:46:39.574953+0000","last_fullsized":"2024-09-16T06:46:39.574953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:52.785229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.378908+0000","last_change":"2024-09-16T06:46:39.186930+0000","last_active":"2024-09-16T06:46:39.378908+0000","last_peered":"2024-09-16T06:46:39.378908+0000","last_clean":"2024-09-16T06:46:39.378908+0000","last_became_active":"2024-09-16T06:46:39.179564+0000","last_became_peered":"2024-09-16T06:46:39.179564+0000","last_unstale":"2024-09-16T06:46:39.378908+0000","last_undegraded":"2024-09-16T06:46:39.378908+0000","last_fullsized":"2024-09-16T06:46:39.378908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374942+0000","last_change":"2024-09-16T06:46:39.175212+0000","last_active":"2024-09-16T06:46:39.374942+0000","last_peered":"2024-09-16T06:46:39.374942+0000","last_clean":"2024-09-16T06:46:39.374942+0000","last_became_active":"2024-09-16T06:46:39.175010+0000","last_became_peered":"2024-09-16T06:46:39.175010+0000","last_unstale":"2024-09-16T06:46:39.374942+0000","last_undegraded":"2024-09-16T06:46:39.374942+0000","last_fullsized":"2024-09-16T06:46:39.374942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:45.991634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379170+0000","last_change":"2024-09-16T06:46:38.833982+0000","last_active":"2024-09-16T06:46:39.379170+0000","last_peered":"2024-09-16T06:46:39.379170+0000","last_clean":"2024-09-16T06:46:39.379170+0000","last_became_active":"2024-09-16T06:46:38.833337+0000","last_became_peered":"2024-09-16T06:46:38.833337+0000","last_unstale":"2024-09-16T06:46:39.379170+0000","last_undegraded":"2024-09-16T06:46:39.379170+0000","last_fullsized":"2024-09-16T06:46:39.379170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574266+0000","last_change":"2024-09-16T06:46:39.192612+0000","last_active":"2024-09-16T06:46:39.574266+0000","last_peered":"2024-09-16T06:46:39.574266+0000","last_clean":"2024-09-16T06:46:39.574266+0000","last_became_active":"2024-09-16T06:46:39.192292+0000","last_became_peered":"2024-09-16T06:46:39.192292+0000","last_unstale":"2024-09-16T06:46:39.574266+0000","last_undegraded":"2024-09-16T06:46:39.574266+0000","last_fullsized":"2024-09-16T06:46:39.574266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:50.366276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.573272+0000","last_change":"2024-09-16T06:46:38.845796+0000","last_active":"2024-09-16T06:46:39.573272+0000","last_peered":"2024-09-16T06:46:39.573272+0000","last_clean":"2024-09-16T06:46:39.573272+0000","last_became_active":"2024-09-16T06:46:38.845067+0000","last_became_peered":"2024-09-16T06:46:38.845067+0000","last_unstale":"2024-09-16T06:46:39.573272+0000","last_undegraded":"2024-09-16T06:46:39.573272+0000","last_fullsized":"2024-09-16T06:46:39.573272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:46.841092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382233+0000","last_change":"2024-09-16T06:46:39.197876+0000","last_active":"2024-09-16T06:46:39.382233+0000","last_peered":"2024-09-16T06:46:39.382233+0000","last_clean":"2024-09-16T06:46:39.382233+0000","last_became_active":"2024-09-16T06:46:39.197577+0000","last_became_peered":"2024-09-16T06:46:39.197577+0000","last_unstale":"2024-09-16T06:46:39.382233+0000","last_undegraded":"2024-09-16T06:46:39.382233+0000","last_fullsized":"2024-09-16T06:46:39.382233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:38.035227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373743+0000","last_change":"2024-09-16T06:46:38.828782+0000","last_active":"2024-09-16T06:46:39.373743+0000","last_peered":"2024-09-16T06:46:39.373743+0000","last_clean":"2024-09-16T06:46:39.373743+0000","last_became_active":"2024-09-16T06:46:38.827397+0000","last_became_peered":"2024-09-16T06:46:38.827397+0000","last_unstale":"2024-09-16T06:46:39.373743+0000","last_undegraded":"2024-09-16T06:46:39.373743+0000","last_fullsized":"2024-09-16T06:46:39.373743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:13.559277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380975+0000","last_change":"2024-09-16T06:46:39.197981+0000","last_active":"2024-09-16T06:46:39.380975+0000","last_peered":"2024-09-16T06:46:39.380975+0000","last_clean":"2024-09-16T06:46:39.380975+0000","last_became_active":"2024-09-16T06:46:39.197563+0000","last_became_peered":"2024-09-16T06:46:39.197563+0000","last_unstale":"2024-09-16T06:46:39.380975+0000","last_undegraded":"2024-09-16T06:46:39.380975+0000","last_fullsized":"2024-09-16T06:46:39.380975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:13:04.098374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.380879+0000","last_change":"2024-09-16T06:46:38.820441+0000","last_active":"2024-09-16T06:46:39.380879+0000","last_peered":"2024-09-16T06:46:39.380879+0000","last_clean":"2024-09-16T06:46:39.380879+0000","last_became_active":"2024-09-16T06:46:38.819557+0000","last_became_peered":"2024-09-16T06:46:38.819557+0000","last_unstale":"2024-09-16T06:46:39.380879+0000","last_undegraded":"2024-09-16T06:46:39.380879+0000","last_fullsized":"2024-09-16T06:46:39.380879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:53.345033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379674+0000","last_change":"2024-09-16T06:46:39.195683+0000","last_active":"2024-09-16T06:46:39.379674+0000","last_peered":"2024-09-16T06:46:39.379674+0000","last_clean":"2024-09-16T06:46:39.379674+0000","last_became_active":"2024-09-16T06:46:39.195257+0000","last_became_peered":"2024-09-16T06:46:39.195257+0000","last_unstale":"2024-09-16T06:46:39.379674+0000","last_undegraded":"2024-09-16T06:46:39.379674+0000","last_fullsized":"2024-09-16T06:46:39.379674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:30:45.567439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574872+0000","last_change":"2024-09-16T06:46:38.845647+0000","last_active":"2024-09-16T06:46:39.574872+0000","last_peered":"2024-09-16T06:46:39.574872+0000","last_clean":"2024-09-16T06:46:39.574872+0000","last_became_active":"2024-09-16T06:46:38.842456+0000","last_became_peered":"2024-09-16T06:46:38.842456+0000","last_unstale":"2024-09-16T06:46:39.574872+0000","last_undegraded":"2024-09-16T06:46:39.574872+0000","last_fullsized":"2024-09-16T06:46:39.574872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:14.727696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373566+0000","last_change":"2024-09-16T06:46:39.165157+0000","last_active":"2024-09-16T06:46:39.373566+0000","last_peered":"2024-09-16T06:46:39.373566+0000","last_clean":"2024-09-16T06:46:39.373566+0000","last_became_active":"2024-09-16T06:46:39.164481+0000","last_became_peered":"2024-09-16T06:46:39.164481+0000","last_unstale":"2024-09-16T06:46:39.373566+0000","last_undegraded":"2024-09-16T06:46:39.373566+0000","last_fullsized":"2024-09-16T06:46:39.373566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:33.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.374569+0000","last_change":"2024-09-16T06:46:38.811325+0000","last_active":"2024-09-16T06:46:39.374569+0000","last_peered":"2024-09-16T06:46:39.374569+0000","last_clean":"2024-09-16T06:46:39.374569+0000","last_became_active":"2024-09-16T06:46:38.811045+0000","last_became_peered":"2024-09-16T06:46:38.811045+0000","last_unstale":"2024-09-16T06:46:39.374569+0000","last_undegraded":"2024-09-16T06:46:39.374569+0000","last_fullsized":"2024-09-16T06:46:39.374569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:13:09.927559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.379772+0000","last_change":"2024-09-16T06:46:39.201473+0000","last_active":"2024-09-16T06:46:39.379772+0000","last_peered":"2024-09-16T06:46:39.379772+0000","last_clean":"2024-09-16T06:46:39.379772+0000","last_became_active":"2024-09-16T06:46:39.195802+0000","last_became_peered":"2024-09-16T06:46:39.195802+0000","last_unstale":"2024-09-16T06:46:39.379772+0000","last_undegraded":"2024-09-16T06:46:39.379772+0000","last_fullsized":"2024-09-16T06:46:39.379772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:32:34.950796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.382822+0000","last_change":"2024-09-16T06:46:38.818893+0000","last_active":"2024-09-16T06:46:39.382822+0000","last_peered":"2024-09-16T06:46:39.382822+0000","last_clean":"2024-09-16T06:46:39.382822+0000","last_became_active":"2024-09-16T06:46:38.818126+0000","last_became_peered":"2024-09-16T06:46:38.818126+0000","last_unstale":"2024-09-16T06:46:39.382822+0000","last_undegraded":"2024-09-16T06:46:39.382822+0000","last_fullsized":"2024-09-16T06:46:39.382822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:07:21.946452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.373312+0000","last_change":"2024-09-16T06:46:39.181737+0000","last_active":"2024-09-16T06:46:39.373312+0000","last_peered":"2024-09-16T06:46:39.373312+0000","last_clean":"2024-09-16T06:46:39.373312+0000","last_became_active":"2024-09-16T06:46:39.181022+0000","last_became_peered":"2024-09-16T06:46:39.181022+0000","last_unstale":"2024-09-16T06:46:39.373312+0000","last_undegraded":"2024-09-16T06:46:39.373312+0000","last_fullsized":"2024-09-16T06:46:39.373312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:38.764982+0000","last_clean_scrub_stamp":"2024-09-16T06:46:38.764982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:59.453293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-16T06:46:39.574823+0000","last_change":"2024-09-16T06:46:38.845870+0000","last_active":"2024-09-16T06:46:39.574823+0000","last_peered":"2024-09-16T06:46:39.574823+0000","last_clean":"2024-09-16T06:46:39.574823+0000","last_became_active":"2024-09-16T06:46:38.837200+0000","last_became_peered":"2024-09-16T06:46:38.837200+0000","last_unstale":"2024-09-16T06:46:39.574823+0000","last_undegraded":"2024-09-16T06:46:39.574823+0000","last_fullsized":"2024-09-16T06:46:39.574823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T06:46:37.754055+0000","last_clean_scrub_stamp":"2024-09-16T06:46:37.754055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:14:31.448697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12274,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":65043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":262144,"data_stored":657453,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":655840,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":66558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6137,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T06:46:46.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T06:46:46.705 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T06:46:46.705 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T06:46:46.705 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T06:46:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c7d7ff640 1 Processor -- start 2024-09-16T06:46:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c7d7ff640 1 -- start start 2024-09-16T06:46:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c7d7ff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1c780a8500 0x7f1c780aa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c7d7ff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c780aaa50 0x7f1c78141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c7d7ff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7806fd60 con 0x7f1c781421f0 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c7d7ff640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c78070020 con 0x7f1c780a8500 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c7d7ff640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7806fa20 con 0x7f1c780aaa50 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c780aaa50 0x7f1c78141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c780aaa50 0x7f1c78141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56218/0 (socket says 172.21.15.96:56218) 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c777fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1c781421f0 0x7f1c781449c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52478/0 (socket says 172.21.15.96:52478) 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c767fc640 1 -- 172.21.15.96:0/640836451 learned_addr learned my addr 172.21.15.96:0/640836451 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.855+0000 7f1c76ffd640 1 --2- 172.21.15.96:0/640836451 >> v2:172.21.15.96:3300/0 conn(0x7f1c780a8500 0x7f1c780aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c767fc640 1 -- 172.21.15.96:0/640836451 >> v2:172.21.15.96:3300/0 conn(0x7f1c780a8500 msgr2=0x7f1c780aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c767fc640 1 --2- 172.21.15.96:0/640836451 >> v2:172.21.15.96:3300/0 conn(0x7f1c780a8500 0x7f1c780aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c767fc640 1 -- 172.21.15.96:0/640836451 >> v1:172.21.15.96:6789/0 conn(0x7f1c781421f0 legacy=0x7f1c781449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c75ffb640 1 -- 172.21.15.96:0/640836451 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789066144 0 0) 0x7f1c7806fd60 con 0x7f1c781421f0 2024-09-16T06:46:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c767fc640 1 -- 172.21.15.96:0/640836451 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780a88e0 con 0x7f1c780aaa50 2024-09-16T06:46:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c76ffd640 1 --2- 172.21.15.96:0/640836451 >> v2:172.21.15.96:3300/0 conn(0x7f1c780a8500 0x7f1c780aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c767fc640 1 --2- 172.21.15.96:0/640836451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c780aaa50 0x7f1c78141cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009870 tx=0x7f1c6801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88cc146b79734170 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c75ffb640 1 -- 172.21.15.96:0/640836451 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680ab600 con 0x7f1c780aaa50 2024-09-16T06:46:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c75ffb640 1 -- 172.21.15.96:0/640836451 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c680a7050 con 0x7f1c780aaa50 2024-09-16T06:46:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c75ffb640 1 -- 172.21.15.96:0/640836451 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680ab980 con 0x7f1c780aaa50 2024-09-16T06:46:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/640836451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c780aaa50 msgr2=0x7f1c78141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/640836451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c780aaa50 0x7f1c78141cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009870 tx=0x7f1c6801c420 comp rx=0 tx=0).stop 2024-09-16T06:46:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/640836451 shutdown_connections 2024-09-16T06:46:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/640836451 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c780aaa50 0x7f1c78141cb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/640836451 >> v2:172.21.15.96:3300/0 conn(0x7f1c780a8500 0x7f1c780aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/640836451 >> 172.21.15.96:0/640836451 conn(0x7f1c780b7730 msgr2=0x7f1c780b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/640836451 shutdown_connections 2024-09-16T06:46:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.859+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/640836451 wait complete. 2024-09-16T06:46:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 Processor -- start 2024-09-16T06:46:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 -- start start 2024-09-16T06:46:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c780a8500 0x7f1c7814b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c780aaa50 0x7f1c781d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c781421f0 0x7f1c781da140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7813f6c0 con 0x7f1c780aaa50 2024-09-16T06:46:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781d94f0 con 0x7f1c780a8500 2024-09-16T06:46:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781d97b0 con 0x7f1c781421f0 2024-09-16T06:46:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c780aaa50 0x7f1c781d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c781421f0 0x7f1c781da140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c780aaa50 0x7f1c781d9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59558/0 (socket says 172.21.15.96:59558) 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 -- 172.21.15.96:0/3218100219 learned_addr learned my addr 172.21.15.96:0/3218100219 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 -- 172.21.15.96:0/3218100219 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c781421f0 msgr2=0x7f1c781da140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c781421f0 0x7f1c781da140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 -- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c780a8500 msgr2=0x7f1c7814b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c780a8500 0x7f1c7814b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 -- 172.21.15.96:0/3218100219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c009420 con 0x7f1c780aaa50 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c767fc640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c780aaa50 0x7f1c781d9c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c680ae040 tx=0x7f1c680191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c5f7fe640 1 -- 172.21.15.96:0/3218100219 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680b4420 con 0x7f1c780aaa50 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c5f7fe640 1 -- 172.21.15.96:0/3218100219 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c680b4580 con 0x7f1c780aaa50 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c5f7fe640 1 -- 172.21.15.96:0/3218100219 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680b4930 con 0x7f1c780aaa50 2024-09-16T06:46:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c680094d0 con 0x7f1c780aaa50 2024-09-16T06:46:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c780b40a0 con 0x7f1c780aaa50 2024-09-16T06:46:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.863+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c780ab8d0 con 0x7f1c780aaa50 2024-09-16T06:46:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c5f7fe640 1 -- 172.21.15.96:0/3218100219 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f1c680b2070 con 0x7f1c780aaa50 2024-09-16T06:46:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c5f7fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c5f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c5f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c5f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c5f7fe640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1c64097840 0x7f1c64099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c5f7fe640 1 -- 172.21.15.96:0/3218100219 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f1c681591c0 con 0x7f1c780aaa50 2024-09-16T06:46:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c76ffd640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1c64097840 0x7f1c64099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.867+0000 7f1c76ffd640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1c64097840 0x7f1c64099d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006e90 tx=0x7f1c6c006de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:46.871+0000 7f1c5f7fe640 1 -- 172.21.15.96:0/3218100219 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c681269f0 con 0x7f1c780aaa50 2024-09-16T06:46:47.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.051+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1c780aa510 con 0x7f1c780aaa50 2024-09-16T06:46:47.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.051+0000 7f1c5f7fe640 1 -- 172.21.15.96:0/3218100219 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1c680b0080 con 0x7f1c780aaa50 2024-09-16T06:46:47.056 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:47.056 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T06:46:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 10 mgrc shutdown 2024-09-16T06:46:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1c64097840 msgr2=0x7f1c64099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1c64097840 0x7f1c64099d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c006e90 tx=0x7f1c6c006de0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c780aaa50 msgr2=0x7f1c781d9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c780aaa50 0x7f1c781d9c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c680ae040 tx=0x7f1c680191c0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 shutdown_connections 2024-09-16T06:46:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1c64097840 0x7f1c64099d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c780aaa50 0x7f1c781d9c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1c781421f0 0x7f1c781da140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 --2- 172.21.15.96:0/3218100219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c780a8500 0x7f1c7814b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 >> 172.21.15.96:0/3218100219 conn(0x7f1c780b7730 msgr2=0x7f1c780b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 shutdown_connections 2024-09-16T06:46:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.055+0000 7f1c7d7ff640 1 -- 172.21.15.96:0/3218100219 wait complete. 2024-09-16T06:46:47.073 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T06:46:47.074 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:47.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.175+0000 7fcf011d3640 1 Processor -- start 2024-09-16T06:46:47.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.175+0000 7fcf011d3640 1 -- start start 2024-09-16T06:46:47.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.175+0000 7fcf011d3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcefc0b9c30 0x7fcefc0aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.175+0000 7fcf011d3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0abfb0 0x7fcefc14de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.175+0000 7fcf011d3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc0ba010 con 0x7fcefc139700 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.175+0000 7fcf011d3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc0ab720 con 0x7fcefc0b9c30 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.175+0000 7fcf011d3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc0ab410 con 0x7fcefc0abfb0 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcefc0b9c30 0x7fcefc0aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefb59e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0abfb0 0x7fcefc14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcefc0b9c30 0x7fcefc0aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59560/0 (socket says 172.21.15.96:59560) 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 -- 172.21.15.96:0/2518263604 learned_addr learned my addr 172.21.15.96:0/2518263604 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 -- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0abfb0 msgr2=0x7fcefc14de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 --2- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0abfb0 0x7fcefc14de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 -- 172.21.15.96:0/2518263604 >> v1:172.21.15.96:6789/0 conn(0x7fcefc139700 legacy=0x7fcefc147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 -- 172.21.15.96:0/2518263604 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc146b50 con 0x7fcefc0b9c30 2024-09-16T06:46:47.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefb59e640 1 --2- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0abfb0 0x7fcefc14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:47.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcefad9d640 1 --2- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc0b9c30 0x7fcefc0aaed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceec009870 tx=0x7fceec01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd02ca8e5092d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcef9d9b640 1 -- 172.21.15.96:0/2518263604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a8a30 con 0x7fcefc0b9c30 2024-09-16T06:46:47.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcef9d9b640 1 -- 172.21.15.96:0/2518263604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec0a8b90 con 0x7fcefc0b9c30 2024-09-16T06:46:47.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcef9d9b640 1 -- 172.21.15.96:0/2518263604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0b0440 con 0x7fcefc0b9c30 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 -- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc0b9c30 msgr2=0x7fcefc0aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 --2- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc0b9c30 0x7fcefc0aaed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fceec009870 tx=0x7fceec01ed30 comp rx=0 tx=0).stop 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 -- 172.21.15.96:0/2518263604 shutdown_connections 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 --2- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0abfb0 0x7fcefc14de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 --2- 172.21.15.96:0/2518263604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc0b9c30 0x7fcefc0aaed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 -- 172.21.15.96:0/2518263604 >> 172.21.15.96:0/2518263604 conn(0x7fcefc06b4a0 msgr2=0x7fcefc06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 -- 172.21.15.96:0/2518263604 shutdown_connections 2024-09-16T06:46:47.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.179+0000 7fcf011d3640 1 -- 172.21.15.96:0/2518263604 wait complete. 2024-09-16T06:46:47.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 Processor -- start 2024-09-16T06:46:47.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 -- start start 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcefc0abfb0 0x7fcefc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0b9c30 0x7fcefc130090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc139700 0x7fcefc1305d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc132e40 con 0x7fcefc139700 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc130cb0 con 0x7fcefc0abfb0 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc130f70 con 0x7fcefc0b9c30 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0b9c30 0x7fcefc130090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefb59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc139700 0x7fcefc1305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0b9c30 0x7fcefc130090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56240/0 (socket says 172.21.15.96:56240) 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefb59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc139700 0x7fcefc1305d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59564/0 (socket says 172.21.15.96:59564) 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 -- 172.21.15.96:0/775746088 learned_addr learned my addr 172.21.15.96:0/775746088 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefad9d640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcefc0abfb0 0x7fcefc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 -- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcefc0abfb0 msgr2=0x7fcefc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcefc0abfb0 0x7fcefc0707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 -- 172.21.15.96:0/775746088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc139700 msgr2=0x7fcefc1305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc139700 0x7fcefc1305d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 -- 172.21.15.96:0/775746088 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4009a70 con 0x7fcefc0b9c30 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcefa59c640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0b9c30 0x7fcefc130090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcef000c3c0 tx=0x7fcef000c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcee37fe640 1 -- 172.21.15.96:0/775746088 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef00052d0 con 0x7fcefc0b9c30 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcee37fe640 1 -- 172.21.15.96:0/775746088 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef0005430 con 0x7fcefc0b9c30 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0094d0 con 0x7fcefc0b9c30 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcee37fe640 1 -- 172.21.15.96:0/775746088 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0003840 con 0x7fcefc0b9c30 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc133090 con 0x7fcefc0b9c30 2024-09-16T06:46:47.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc0aa410 con 0x7fcefc0b9c30 2024-09-16T06:46:47.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcee37fe640 1 -- 172.21.15.96:0/775746088 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fcef00039a0 con 0x7fcefc0b9c30 2024-09-16T06:46:47.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.183+0000 7fcee37fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:47.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcee37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:47.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcee37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:47.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcee37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:47.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcee37fe640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fcee8097840 0x7fcee8099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcee37fe640 1 -- 172.21.15.96:0/775746088 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fcef00bf7d0 con 0x7fcefc0b9c30 2024-09-16T06:46:47.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcefad9d640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fcee8097840 0x7fcee8099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcefad9d640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fcee8097840 0x7fcee8099d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fceec0b2000 tx=0x7fceec0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.187+0000 7fcee37fe640 1 -- 172.21.15.96:0/775746088 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcef008ce40 con 0x7fcefc0b9c30 2024-09-16T06:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.335+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcefc0a7210 con 0x7fcefc0b9c30 2024-09-16T06:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcee37fe640 1 -- 172.21.15.96:0/775746088 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7fcef0017090 con 0x7fcefc0b9c30 2024-09-16T06:46:47.341 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:47.341 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 10 mgrc shutdown 2024-09-16T06:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fcee8097840 msgr2=0x7fcee8099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fcee8097840 0x7fcee8099d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fceec0b2000 tx=0x7fceec0aa070 comp rx=0 tx=0).stop 2024-09-16T06:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0b9c30 msgr2=0x7fcefc130090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0b9c30 0x7fcefc130090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcef000c3c0 tx=0x7fcef000c7c0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 shutdown_connections 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fcee8097840 0x7fcee8099d00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcefc139700 0x7fcefc1305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fcefc0b9c30 0x7fcefc130090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 --2- 172.21.15.96:0/775746088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcefc0abfb0 0x7fcefc0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 >> 172.21.15.96:0/775746088 conn(0x7fcefc06b4a0 msgr2=0x7fcefc0a7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 shutdown_connections 2024-09-16T06:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.339+0000 7fcf011d3640 1 -- 172.21.15.96:0/775746088 wait complete. 2024-09-16T06:46:47.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T06:46:26.589352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-16T06:46:31.515422+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T06:46:37.467661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T06:46:38.139243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T06:46:47.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T06:46:47.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.463+0000 7ff93244d640 1 Processor -- start 2024-09-16T06:46:47.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.463+0000 7ff93244d640 1 -- start start 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c133610 0x7ff92c0a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff92c136b30 0x7ff92c14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c0a3970 con 0x7ff92c0a6fe0 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c132e60 con 0x7ff92c136b30 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c132b30 con 0x7ff92c133610 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c133610 0x7ff92c0a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c133610 0x7ff92c0a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56254/0 (socket says 172.21.15.96:56254) 2024-09-16T06:46:47.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 -- 172.21.15.96:0/2409218275 learned_addr learned my addr 172.21.15.96:0/2409218275 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:47.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff9309ea640 1 --2- 172.21.15.96:0/2409218275 >> v2:172.21.15.134:3300/0 conn(0x7ff92c136b30 0x7ff92c14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 -- 172.21.15.96:0/2409218275 >> v2:172.21.15.134:3300/0 conn(0x7ff92c136b30 msgr2=0x7ff92c14ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:47.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 --2- 172.21.15.96:0/2409218275 >> v2:172.21.15.134:3300/0 conn(0x7ff92c136b30 0x7ff92c14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 -- 172.21.15.96:0/2409218275 >> v1:172.21.15.134:6789/0 conn(0x7ff92c0a6fe0 legacy=0x7ff92c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:47.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 -- 172.21.15.96:0/2409218275 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c1339f0 con 0x7ff92c133610 2024-09-16T06:46:47.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92bfff640 1 --2- 172.21.15.96:0/2409218275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c133610 0x7ff92c0a6aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009870 tx=0x7ff91c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=987636368febf72f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92affd640 1 -- 172.21.15.96:0/2409218275 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0ab600 con 0x7ff92c133610 2024-09-16T06:46:47.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92affd640 1 -- 172.21.15.96:0/2409218275 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c0a7050 con 0x7ff92c133610 2024-09-16T06:46:47.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff92affd640 1 -- 172.21.15.96:0/2409218275 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c0ab980 con 0x7ff92c133610 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- 172.21.15.96:0/2409218275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c133610 msgr2=0x7ff92c0a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 --2- 172.21.15.96:0/2409218275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c133610 0x7ff92c0a6aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009870 tx=0x7ff91c01c470 comp rx=0 tx=0).stop 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- 172.21.15.96:0/2409218275 shutdown_connections 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 --2- 172.21.15.96:0/2409218275 >> v2:172.21.15.134:3300/0 conn(0x7ff92c136b30 0x7ff92c14ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 --2- 172.21.15.96:0/2409218275 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c133610 0x7ff92c0a6aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- 172.21.15.96:0/2409218275 >> 172.21.15.96:0/2409218275 conn(0x7ff92c0a4520 msgr2=0x7ff92c0a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- 172.21.15.96:0/2409218275 shutdown_connections 2024-09-16T06:46:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.467+0000 7ff93244d640 1 -- 172.21.15.96:0/2409218275 wait complete. 2024-09-16T06:46:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 Processor -- start 2024-09-16T06:46:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 -- start start 2024-09-16T06:46:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff92c0a6fe0 0x7ff92c149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff92c133610 0x7ff92c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c136b30 0x7ff92c1405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c14ab10 con 0x7ff92c0a6fe0 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c14a350 con 0x7ff92c133610 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0b4e00 con 0x7ff92c136b30 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c136b30 0x7ff92c1405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff92c0a6fe0 0x7ff92c149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c136b30 0x7ff92c1405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56266/0 (socket says 172.21.15.96:56266) 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 -- 172.21.15.96:0/3549191751 learned_addr learned my addr 172.21.15.96:0/3549191751 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff92b7fe640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff92c133610 0x7ff92c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 -- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff92c133610 msgr2=0x7ff92c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff92c133610 0x7ff92c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 -- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff92c0a6fe0 msgr2=0x7ff92c149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff92c0a6fe0 0x7ff92c149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 -- 172.21.15.96:0/3549191751 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0094d0 con 0x7ff92c136b30 2024-09-16T06:46:47.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff92bfff640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff92c0a6fe0 0x7ff92c149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:47.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff9309ea640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c136b30 0x7ff92c1405e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff92400cbd0 tx=0x7ff92400a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff928ff9640 1 -- 172.21.15.96:0/3549191751 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92400ccc0 con 0x7ff92c136b30 2024-09-16T06:46:47.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff928ff9640 1 -- 172.21.15.96:0/3549191751 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92400ce20 con 0x7ff92c136b30 2024-09-16T06:46:47.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c0b50c0 con 0x7ff92c136b30 2024-09-16T06:46:47.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff928ff9640 1 -- 172.21.15.96:0/3549191751 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924003bc0 con 0x7ff92c136b30 2024-09-16T06:46:47.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c0b40c0 con 0x7ff92c136b30 2024-09-16T06:46:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c14ac80 con 0x7ff92c136b30 2024-09-16T06:46:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff928ff9640 1 -- 172.21.15.96:0/3549191751 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7ff92400f3f0 con 0x7ff92c136b30 2024-09-16T06:46:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.471+0000 7ff928ff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.475+0000 7ff928ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.475+0000 7ff928ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.475+0000 7ff928ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.475+0000 7ff928ff9640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff918097840 0x7ff918099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.475+0000 7ff928ff9640 1 -- 172.21.15.96:0/3549191751 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7ff9240bff70 con 0x7ff92c136b30 2024-09-16T06:46:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.475+0000 7ff92bfff640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff918097840 0x7ff918099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.475+0000 7ff92bfff640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff918097840 0x7ff918099d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0ad000 tx=0x7ff91c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.479+0000 7ff928ff9640 1 -- 172.21.15.96:0/3549191751 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff9240f1db0 con 0x7ff92c136b30 2024-09-16T06:46:47.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.623+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff92c0a6aa0 con 0x7ff92c136b30 2024-09-16T06:46:47.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff928ff9640 1 -- 172.21.15.96:0/3549191751 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff92401d020 con 0x7ff92c136b30 2024-09-16T06:46:47.628 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 10 mgrc shutdown 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff918097840 msgr2=0x7ff918099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff918097840 0x7ff918099d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0ad000 tx=0x7ff91c0a6000 comp rx=0 tx=0).stop 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c136b30 msgr2=0x7ff92c1405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c136b30 0x7ff92c1405e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff92400cbd0 tx=0x7ff92400a5c0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 shutdown_connections 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff918097840 0x7ff918099d00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff92c136b30 0x7ff92c1405e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff92c133610 0x7ff92c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 --2- 172.21.15.96:0/3549191751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff92c0a6fe0 0x7ff92c149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 >> 172.21.15.96:0/3549191751 conn(0x7ff92c0a4520 msgr2=0x7ff92c0a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 shutdown_connections 2024-09-16T06:46:47.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.627+0000 7ff93244d640 1 -- 172.21.15.96:0/3549191751 wait complete. 2024-09-16T06:46:47.646 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-16T06:46:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.763+0000 7f2f2b026640 1 Processor -- start 2024-09-16T06:46:47.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f2b026640 1 -- start start 2024-09-16T06:46:47.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f2b026640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2f2406d700 0x7f2f2406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f2b026640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2406a320 con 0x7f2f24069f40 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f2b026640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2406db30 con 0x7f2f241453d0 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f2b026640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2406ad00 con 0x7f2f2406d700 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f28dc2640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2f24069f40 0x7f2f24144cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52506/0 (socket says 172.21.15.96:52506) 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f28dc2640 1 -- 172.21.15.96:0/2644898423 learned_addr learned my addr 172.21.15.96:0/2644898423 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f23fff640 1 --2- 172.21.15.96:0/2644898423 >> v2:172.21.15.96:3300/0 conn(0x7f2f2406d700 0x7f2f2406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f23fff640 1 -- 172.21.15.96:0/2644898423 >> v1:172.21.15.134:6789/0 conn(0x7f2f241453d0 legacy=0x7f2f2414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f23fff640 1 -- 172.21.15.96:0/2644898423 >> v1:172.21.15.96:6789/0 conn(0x7f2f24069f40 legacy=0x7f2f24144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f23fff640 1 -- 172.21.15.96:0/2644898423 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2406e840 con 0x7f2f2406d700 2024-09-16T06:46:47.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f237fe640 1 -- 172.21.15.96:0/2644898423 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198173197 0 0) 0x7f2f2406a320 con 0x7f2f24069f40 2024-09-16T06:46:47.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f23fff640 1 --2- 172.21.15.96:0/2644898423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f2406d700 0x7f2f2406a5d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f180097c0 tx=0x7f2f1801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b051920c35531d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f237fe640 1 -- 172.21.15.96:0/2644898423 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180ab600 con 0x7f2f2406d700 2024-09-16T06:46:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f237fe640 1 -- 172.21.15.96:0/2644898423 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f180a7050 con 0x7f2f2406d700 2024-09-16T06:46:47.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.767+0000 7f2f237fe640 1 -- 172.21.15.96:0/2644898423 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180ab980 con 0x7f2f2406d700 2024-09-16T06:46:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/2644898423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f2406d700 msgr2=0x7f2f2406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 --2- 172.21.15.96:0/2644898423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f2406d700 0x7f2f2406a5d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2f180097c0 tx=0x7f2f1801c320 comp rx=0 tx=0).stop 2024-09-16T06:46:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/2644898423 shutdown_connections 2024-09-16T06:46:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 --2- 172.21.15.96:0/2644898423 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f2406d700 0x7f2f2406a5d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/2644898423 >> 172.21.15.96:0/2644898423 conn(0x7f2f240a4520 msgr2=0x7f2f240a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/2644898423 shutdown_connections 2024-09-16T06:46:47.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/2644898423 wait complete. 2024-09-16T06:46:47.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 Processor -- start 2024-09-16T06:46:47.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- start start 2024-09-16T06:46:47.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f24069f40 0x7f2f24148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2406d700 0x7f2f241436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2f241453d0 0x7f2f241423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f241432f0 con 0x7f2f24069f40 2024-09-16T06:46:47.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f24148070 con 0x7f2f2406d700 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f24143030 con 0x7f2f241453d0 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f24069f40 0x7f2f24148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f24069f40 0x7f2f24148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59600/0 (socket says 172.21.15.96:59600) 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f295c3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2f241453d0 0x7f2f241423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 -- 172.21.15.96:0/423211834 learned_addr learned my addr 172.21.15.96:0/423211834 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 -- 172.21.15.96:0/423211834 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2f241453d0 msgr2=0x7f2f241423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2f241453d0 0x7f2f241423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f23fff640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2406d700 0x7f2f241436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 -- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2406d700 msgr2=0x7f2f241436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2406d700 0x7f2f241436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 -- 172.21.15.96:0/423211834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18009420 con 0x7f2f24069f40 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f28dc2640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f24069f40 0x7f2f24148e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c7c0 tx=0x7f2f1c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f217fa640 1 -- 172.21.15.96:0/423211834 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00a5e0 con 0x7f2f24069f40 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f217fa640 1 -- 172.21.15.96:0/423211834 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00a760 con 0x7f2f24069f40 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f24141b70 con 0x7f2f24069f40 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f217fa640 1 -- 172.21.15.96:0/423211834 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00ab10 con 0x7f2f24069f40 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f24142ab0 con 0x7f2f24069f40 2024-09-16T06:46:47.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.771+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2406a5d0 con 0x7f2f24069f40 2024-09-16T06:46:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f217fa640 1 -- 172.21.15.96:0/423211834 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f2f1c00ac70 con 0x7f2f24069f40 2024-09-16T06:46:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f217fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f217fa640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2f10097840 0x7f2f10099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:47.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f217fa640 1 -- 172.21.15.96:0/423211834 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f2f1c0bf4d0 con 0x7f2f24069f40 2024-09-16T06:46:47.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f23fff640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2f10097840 0x7f2f10099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:47.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.775+0000 7f2f23fff640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2f10097840 0x7f2f10099d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f240a8350 tx=0x7f2f18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:47.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.779+0000 7f2f217fa640 1 -- 172.21.15.96:0/423211834 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f1c08cbe0 con 0x7f2f24069f40 2024-09-16T06:46:47.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f24142d60 con 0x7f2f24069f40 2024-09-16T06:46:47.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f217fa640 1 -- 172.21.15.96:0/423211834 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f1c018020 con 0x7f2f24069f40 2024-09-16T06:46:47.942 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-09-16T06:46:47.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 10 mgrc shutdown 2024-09-16T06:46:47.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2f10097840 msgr2=0x7f2f10099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2f10097840 0x7f2f10099d00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f240a8350 tx=0x7f2f18008040 comp rx=0 tx=0).stop 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f24069f40 msgr2=0x7f2f24148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f24069f40 0x7f2f24148e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c7c0 tx=0x7f2f1c00cc80 comp rx=0 tx=0).stop 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 shutdown_connections 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2f10097840 0x7f2f10099d00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2f241453d0 0x7f2f241423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2406d700 0x7f2f241436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 --2- 172.21.15.96:0/423211834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f24069f40 0x7f2f24148e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 >> 172.21.15.96:0/423211834 conn(0x7f2f240a4520 msgr2=0x7f2f240b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.939+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 shutdown_connections 2024-09-16T06:46:47.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:47.943+0000 7f2f2b026640 1 -- 172.21.15.96:0/423211834 wait complete. 2024-09-16T06:46:47.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T06:46:48.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9ea53c2640 1 Processor -- start 2024-09-16T06:46:48.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9ea53c2640 1 -- start start 2024-09-16T06:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9ea53c2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea0147440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9ea53c2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ea0069ce0 0x7f9ea00a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9ea53c2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea0146e60 con 0x7f9ea0139de0 2024-09-16T06:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9ea53c2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea0147120 con 0x7f9ea0069ce0 2024-09-16T06:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9ea53c2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00a68c0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea0147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea0147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56280/0 (socket says 172.21.15.96:56280) 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9e7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ea0069ce0 0x7f9ea00a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 -- 172.21.15.96:0/4094387426 learned_addr learned my addr 172.21.15.96:0/4094387426 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 -- 172.21.15.96:0/4094387426 >> v2:172.21.15.96:3300/0 conn(0x7f9ea0069ce0 msgr2=0x7f9ea00a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 --2- 172.21.15.96:0/4094387426 >> v2:172.21.15.96:3300/0 conn(0x7f9ea0069ce0 0x7f9ea00a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 -- 172.21.15.96:0/4094387426 >> v1:172.21.15.96:6789/0 conn(0x7f9ea0139de0 legacy=0x7f9ea0135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9dffb640 1 -- 172.21.15.96:0/4094387426 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989130307 0 0) 0x7f9ea0146e60 con 0x7f9ea0139de0 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 -- 172.21.15.96:0/4094387426 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00a6040 con 0x7f9ea00a5c60 2024-09-16T06:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9e7fc640 1 --2- 172.21.15.96:0/4094387426 >> v2:172.21.15.96:3300/0 conn(0x7f9ea0069ce0 0x7f9ea00a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.079+0000 7f9e9effd640 1 --2- 172.21.15.96:0/4094387426 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea0147440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009870 tx=0x7f9e9001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb64ae46b0750e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9dffb640 1 -- 172.21.15.96:0/4094387426 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0136d00 con 0x7f9ea00a5c60 2024-09-16T06:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9dffb640 1 -- 172.21.15.96:0/4094387426 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e900ab650 con 0x7f9ea00a5c60 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9dffb640 1 -- 172.21.15.96:0/4094387426 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900ab9e0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- 172.21.15.96:0/4094387426 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 msgr2=0x7f9ea0147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/4094387426 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea0147440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009870 tx=0x7f9e9001c4b0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- 172.21.15.96:0/4094387426 shutdown_connections 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/4094387426 >> v2:172.21.15.96:3300/0 conn(0x7f9ea0069ce0 0x7f9ea00a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/4094387426 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea0147440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- 172.21.15.96:0/4094387426 >> 172.21.15.96:0/4094387426 conn(0x7f9ea00a4520 msgr2=0x7f9ea00a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- 172.21.15.96:0/4094387426 shutdown_connections 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- 172.21.15.96:0/4094387426 wait complete. 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 Processor -- start 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- start start 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea0069ce0 0x7f9ea0070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea00a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea0139de0 0x7f9ea009f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea009d1e0 con 0x7f9ea0139de0 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea009d4a0 con 0x7f9ea0069ce0 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea0070870 con 0x7f9ea00a5c60 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea00a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea00a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56294/0 (socket says 172.21.15.96:56294) 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 -- 172.21.15.96:0/2396101651 learned_addr learned my addr 172.21.15.96:0/2396101651 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9f7fe640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea0139de0 0x7f9ea009f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 -- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea0069ce0 msgr2=0x7f9ea0070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea0069ce0 0x7f9ea0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 -- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea0139de0 msgr2=0x7f9ea009f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea0139de0 0x7f9ea009f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 -- 172.21.15.96:0/2396101651 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94009420 con 0x7f9ea00a5c60 2024-09-16T06:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9f7fe640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea0139de0 0x7f9ea009f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e9e7fc640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea00a0c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400ebe0 tx=0x7f9e9400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e877fe640 1 -- 172.21.15.96:0/2396101651 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400eee0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e877fe640 1 -- 172.21.15.96:0/2396101651 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9400cc30 con 0x7f9ea00a5c60 2024-09-16T06:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e900094d0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9e877fe640 1 -- 172.21.15.96:0/2396101651 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94013470 con 0x7f9ea00a5c60 2024-09-16T06:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.083+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea0070c10 con 0x7f9ea00a5c60 2024-09-16T06:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea00a6e70 con 0x7f9ea00a5c60 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e877fe640 1 -- 172.21.15.96:0/2396101651 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f9e940135d0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e877fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e877fe640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9e8c0977c0 0x7f9e8c099c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e877fe640 1 -- 172.21.15.96:0/2396101651 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f9e940c07d0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e9effd640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9e8c0977c0 0x7f9e8c099c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.087+0000 7f9e9effd640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9e8c0977c0 0x7f9e8c099c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e900af000 tx=0x7f9e90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.091+0000 7f9e877fe640 1 -- 172.21.15.96:0/2396101651 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e9408dee0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.247+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ea00709b0 con 0x7f9ea00a5c60 2024-09-16T06:46:48.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.247+0000 7f9e877fe640 1 -- 172.21.15.96:0/2396101651 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e9408fe10 con 0x7f9ea00a5c60 2024-09-16T06:46:48.250 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-09-16T06:46:48.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.247+0000 7f9ea53c2640 10 mgrc shutdown 2024-09-16T06:46:48.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.247+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9e8c0977c0 msgr2=0x7f9e8c099c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.247+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9e8c0977c0 0x7f9e8c099c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9e900af000 tx=0x7f9e90008040 comp rx=0 tx=0).stop 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.247+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 msgr2=0x7f9ea00a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.247+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea00a0c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e9400ebe0 tx=0x7f9e9400c520 comp rx=0 tx=0).stop 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 shutdown_connections 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f9e8c0977c0 0x7f9e8c099c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ea0139de0 0x7f9ea009f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9ea00a5c60 0x7f9ea00a0c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 --2- 172.21.15.96:0/2396101651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ea0069ce0 0x7f9ea0070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 >> 172.21.15.96:0/2396101651 conn(0x7f9ea00a4520 msgr2=0x7f9ea00b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 shutdown_connections 2024-09-16T06:46:48.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.251+0000 7f9ea53c2640 1 -- 172.21.15.96:0/2396101651 wait complete. 2024-09-16T06:46:48.269 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T06:46:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0efb5640 1 Processor -- start 2024-09-16T06:46:48.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0efb5640 1 -- start start 2024-09-16T06:46:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0efb5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f08133610 0x7f0f080a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0efb5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f08136b30 0x7f0f0814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0efb5640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f080a3970 con 0x7f0f080a6fe0 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0efb5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f08132e60 con 0x7f0f08133610 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0efb5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f08132b30 con 0x7f0f08136b30 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0cd51640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f08133610 0x7f0f080a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0cd51640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f08133610 0x7f0f080a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59630/0 (socket says 172.21.15.96:59630) 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0cd51640 1 -- 172.21.15.96:0/821525080 learned_addr learned my addr 172.21.15.96:0/821525080 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0cd51640 1 -- 172.21.15.96:0/821525080 >> v2:172.21.15.134:3300/0 conn(0x7f0f08136b30 msgr2=0x7f0f0814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0cd51640 1 --2- 172.21.15.96:0/821525080 >> v2:172.21.15.134:3300/0 conn(0x7f0f08136b30 0x7f0f0814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0cd51640 1 -- 172.21.15.96:0/821525080 >> v1:172.21.15.134:6789/0 conn(0x7f0f080a6fe0 legacy=0x7f0f0806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:48.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.383+0000 7f0f0cd51640 1 -- 172.21.15.96:0/821525080 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f081339f0 con 0x7f0f08133610 2024-09-16T06:46:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 --2- 172.21.15.96:0/821525080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f08133610 0x7f0f080a6aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0f080a1f10 tx=0x7f0ef801eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5726d858121c066 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f077fe640 1 -- 172.21.15.96:0/821525080 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef800b2d0 con 0x7f0f08133610 2024-09-16T06:46:48.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f077fe640 1 -- 172.21.15.96:0/821525080 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef800b430 con 0x7f0f08133610 2024-09-16T06:46:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f077fe640 1 -- 172.21.15.96:0/821525080 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80a79f0 con 0x7f0f08133610 2024-09-16T06:46:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- 172.21.15.96:0/821525080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f08133610 msgr2=0x7f0f080a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/821525080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f08133610 0x7f0f080a6aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0f080a1f10 tx=0x7f0ef801eb00 comp rx=0 tx=0).stop 2024-09-16T06:46:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- 172.21.15.96:0/821525080 shutdown_connections 2024-09-16T06:46:48.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/821525080 >> v2:172.21.15.134:3300/0 conn(0x7f0f08136b30 0x7f0f0814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/821525080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f08133610 0x7f0f080a6aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- 172.21.15.96:0/821525080 >> 172.21.15.96:0/821525080 conn(0x7f0f080a4520 msgr2=0x7f0f080a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- 172.21.15.96:0/821525080 shutdown_connections 2024-09-16T06:46:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- 172.21.15.96:0/821525080 wait complete. 2024-09-16T06:46:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 Processor -- start 2024-09-16T06:46:48.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- start start 2024-09-16T06:46:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f080a6fe0 0x7f0f080a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f08133610 0x7f0f080b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f08136b30 0x7f0f081db0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f080a68b0 con 0x7f0f080a6fe0 2024-09-16T06:46:48.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08141b70 con 0x7f0f08133610 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f08141e10 con 0x7f0f08136b30 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f080a6fe0 0x7f0f080a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f080a6fe0 0x7f0f080a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59632/0 (socket says 172.21.15.96:59632) 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 -- 172.21.15.96:0/972900093 learned_addr learned my addr 172.21.15.96:0/972900093 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0d552640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f08136b30 0x7f0f081db0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 -- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f08136b30 msgr2=0x7f0f081db0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f08136b30 0x7f0f081db0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 -- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f08133610 msgr2=0x7f0f080b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f07fff640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f08133610 0x7f0f080b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f08133610 0x7f0f080b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 -- 172.21.15.96:0/972900093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef800bd40 con 0x7f0f080a6fe0 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f07fff640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f08133610 0x7f0f080b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:48.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0cd51640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f080a6fe0 0x7f0f080a9e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80b1040 tx=0x7f0ef801b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f057fa640 1 -- 172.21.15.96:0/972900093 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8009a10 con 0x7f0f080a6fe0 2024-09-16T06:46:48.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f057fa640 1 -- 172.21.15.96:0/972900093 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef8009b90 con 0x7f0f080a6fe0 2024-09-16T06:46:48.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f080b2170 con 0x7f0f080a6fe0 2024-09-16T06:46:48.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f057fa640 1 -- 172.21.15.96:0/972900093 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80ba470 con 0x7f0f080a6fe0 2024-09-16T06:46:48.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.387+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f080abd50 con 0x7f0f080a6fe0 2024-09-16T06:46:48.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f080a69f0 con 0x7f0f080a6fe0 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f057fa640 1 -- 172.21.15.96:0/972900093 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f0ef80ba5d0 con 0x7f0f080a6fe0 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f057fa640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f057fa640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0ef4097870 0x7f0ef4099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f057fa640 1 -- 172.21.15.96:0/972900093 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f0ef815db30 con 0x7f0f080a6fe0 2024-09-16T06:46:48.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f07fff640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0ef4097870 0x7f0ef4099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.391+0000 7f0f07fff640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0ef4097870 0x7f0ef4099d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f080aa390 tx=0x7f0efc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.395+0000 7f0f057fa640 1 -- 172.21.15.96:0/972900093 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0ef812b360 con 0x7f0f080a6fe0 2024-09-16T06:46:48.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f080a3630 con 0x7f0f080a6fe0 2024-09-16T06:46:48.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f057fa640 1 -- 172.21.15.96:0/972900093 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ef80be0a0 con 0x7f0f080a6fe0 2024-09-16T06:46:48.550 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-09-16T06:46:48.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 10 mgrc shutdown 2024-09-16T06:46:48.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0ef4097870 msgr2=0x7f0ef4099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0ef4097870 0x7f0ef4099d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f080aa390 tx=0x7f0efc009040 comp rx=0 tx=0).stop 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f080a6fe0 msgr2=0x7f0f080a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f080a6fe0 0x7f0f080a9e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80b1040 tx=0x7f0ef801b8a0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 shutdown_connections 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f0ef4097870 0x7f0ef4099d30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f08136b30 0x7f0f081db0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f08133610 0x7f0f080b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 --2- 172.21.15.96:0/972900093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f080a6fe0 0x7f0f080a9e50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 >> 172.21.15.96:0/972900093 conn(0x7f0f080a4520 msgr2=0x7f0f080aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 shutdown_connections 2024-09-16T06:46:48.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.547+0000 7f0f0efb5640 1 -- 172.21.15.96:0/972900093 wait complete. 2024-09-16T06:46:48.567 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T06:46:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fe5d42640 1 Processor -- start 2024-09-16T06:46:48.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fe5d42640 1 -- start start 2024-09-16T06:46:48.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fe5d42640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2fe00a5100 0x7f2fe006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fe5d42640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2fe0137b20 0x7f2fe014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fe5d42640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe01449e0 con 0x7f2fe00a40e0 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fe5d42640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe00a54e0 con 0x7f2fe0137b20 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fe5d42640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe006d7b0 con 0x7f2fe00a5100 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fdffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2fe0137b20 0x7f2fe014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fdffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2fe0137b20 0x7f2fe014bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59636/0 (socket says 172.21.15.96:59636) 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.671+0000 7f2fdffff640 1 -- 172.21.15.96:0/981797886 learned_addr learned my addr 172.21.15.96:0/981797886 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fdf7fe640 1 --2- 172.21.15.96:0/981797886 >> v2:172.21.15.134:3300/0 conn(0x7f2fe00a5100 0x7f2fe006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fdffff640 1 -- 172.21.15.96:0/981797886 >> v2:172.21.15.134:3300/0 conn(0x7f2fe00a5100 msgr2=0x7f2fe006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fdffff640 1 --2- 172.21.15.96:0/981797886 >> v2:172.21.15.134:3300/0 conn(0x7f2fe00a5100 0x7f2fe006e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fdffff640 1 -- 172.21.15.96:0/981797886 >> v1:172.21.15.134:6789/0 conn(0x7f2fe00a40e0 legacy=0x7f2fe0144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fdffff640 1 -- 172.21.15.96:0/981797886 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0144c10 con 0x7f2fe0137b20 2024-09-16T06:46:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fdffff640 1 --2- 172.21.15.96:0/981797886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe0137b20 0x7f2fe014bd10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00a7ba0 tx=0x7f2fd801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bbfc8a92939c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fde7fc640 1 -- 172.21.15.96:0/981797886 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80ac600 con 0x7f2fe0137b20 2024-09-16T06:46:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fde7fc640 1 -- 172.21.15.96:0/981797886 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd80a8050 con 0x7f2fe0137b20 2024-09-16T06:46:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fde7fc640 1 -- 172.21.15.96:0/981797886 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80ac980 con 0x7f2fe0137b20 2024-09-16T06:46:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 -- 172.21.15.96:0/981797886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe0137b20 msgr2=0x7f2fe014bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/981797886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe0137b20 0x7f2fe014bd10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00a7ba0 tx=0x7f2fd801c530 comp rx=0 tx=0).stop 2024-09-16T06:46:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 -- 172.21.15.96:0/981797886 shutdown_connections 2024-09-16T06:46:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/981797886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe0137b20 0x7f2fe014bd10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/981797886 >> v2:172.21.15.134:3300/0 conn(0x7f2fe00a5100 0x7f2fe006e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 -- 172.21.15.96:0/981797886 >> 172.21.15.96:0/981797886 conn(0x7f2fe006b8a0 msgr2=0x7f2fe00a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:48.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 -- 172.21.15.96:0/981797886 shutdown_connections 2024-09-16T06:46:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.675+0000 7f2fe5d42640 1 -- 172.21.15.96:0/981797886 wait complete. 2024-09-16T06:46:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 Processor -- start 2024-09-16T06:46:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 -- start start 2024-09-16T06:46:48.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2fe00a40e0 0x7f2fe00aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe00a5100 0x7f2fe00a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe0137b20 0x7f2fe00b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe01414d0 con 0x7f2fe00a5100 2024-09-16T06:46:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00af6b0 con 0x7f2fe0137b20 2024-09-16T06:46:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe00af970 con 0x7f2fe00a40e0 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe00a5100 0x7f2fe00a90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdf7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2fe00a40e0 0x7f2fe00aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdf7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2fe00a40e0 0x7f2fe00aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56322/0 (socket says 172.21.15.96:56322) 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe00a5100 0x7f2fe00a90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59642/0 (socket says 172.21.15.96:59642) 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdf7fe640 1 -- 172.21.15.96:0/388661480 learned_addr learned my addr 172.21.15.96:0/388661480 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdffff640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe0137b20 0x7f2fe00b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 -- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2fe00a40e0 msgr2=0x7f2fe00aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2fe00a40e0 0x7f2fe00aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 -- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe0137b20 msgr2=0x7f2fe00b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe0137b20 0x7f2fe00b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 -- 172.21.15.96:0/388661480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80094d0 con 0x7f2fe00a5100 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdf7fe640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2fe00a40e0 0x7f2fe00aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fdeffd640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe00a5100 0x7f2fe00a90c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8000f70 tx=0x7f2fc800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fd7fff640 1 -- 172.21.15.96:0/388661480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80052d0 con 0x7f2fe00a5100 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fd7fff640 1 -- 172.21.15.96:0/388661480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc8005430 con 0x7f2fe00a5100 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe00ae990 con 0x7f2fe00a5100 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fd7fff640 1 -- 172.21.15.96:0/388661480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8003840 con 0x7f2fe00a5100 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe00af3c0 con 0x7f2fe00a5100 2024-09-16T06:46:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.679+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe006e7d0 con 0x7f2fe00a5100 2024-09-16T06:46:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 1 -- 172.21.15.96:0/388661480 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f2fc80039a0 con 0x7f2fe00a5100 2024-09-16T06:46:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:48.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2fc0097840 0x7f2fc0099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 1 -- 172.21.15.96:0/388661480 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f2fc80bf900 con 0x7f2fe00a5100 2024-09-16T06:46:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fdf7fe640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2fc0097840 0x7f2fc0099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fdf7fe640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2fc0097840 0x7f2fc0099d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0007900 tx=0x7f2fd0009950 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.683+0000 7f2fd7fff640 1 -- 172.21.15.96:0/388661480 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2fc808d0c0 con 0x7f2fe00a5100 2024-09-16T06:46:48.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.863+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fe00a2d00 con 0x7f2fe00a5100 2024-09-16T06:46:48.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.863+0000 7f2fd7fff640 1 -- 172.21.15.96:0/388661480 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f2fc808eff0 con 0x7f2fe00a5100 2024-09-16T06:46:48.868 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:48.868 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6809/2274498401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2274498401},{"type":"v1","addr":"172.21.15.96:6809","nonce":2274498401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6811/2101624097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2101624097},{"type":"v1","addr":"172.21.15.96:6811","nonce":2101624097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T06:46:39.151294+0000","modified":"2024-09-16T06:46:41.789469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6827/3093802738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3093802738},{"type":"v1","addr":"172.21.15.134:6827","nonce":3093802738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-16T06:46:48.868 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-09-16T06:46:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 10 mgrc shutdown 2024-09-16T06:46:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2fc0097840 msgr2=0x7f2fc0099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2fc0097840 0x7f2fc0099d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0007900 tx=0x7f2fd0009950 comp rx=0 tx=0).stop 2024-09-16T06:46:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe00a5100 msgr2=0x7f2fe00a90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe00a5100 0x7f2fe00a90c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8000f70 tx=0x7f2fc800c890 comp rx=0 tx=0).stop 2024-09-16T06:46:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 shutdown_connections 2024-09-16T06:46:48.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2fc0097840 0x7f2fc0099d00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fe00a5100 0x7f2fe00a90c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fe0137b20 0x7f2fe00b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 --2- 172.21.15.96:0/388661480 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2fe00a40e0 0x7f2fe00aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 >> 172.21.15.96:0/388661480 conn(0x7f2fe006b8a0 msgr2=0x7f2fe01429e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 shutdown_connections 2024-09-16T06:46:48.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.867+0000 7f2fe5d42640 1 -- 172.21.15.96:0/388661480 wait complete. 2024-09-16T06:46:48.886 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:49.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9c54df640 1 Processor -- start 2024-09-16T06:46:49.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9c54df640 1 -- start start 2024-09-16T06:46:49.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9c54df640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006fa90 0x7fc9c006f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9c54df640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc9c0070ed0 0x7fc9c0139c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9c54df640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c006bae0 con 0x7fc9c006b700 2024-09-16T06:46:49.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9c54df640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c01473a0 con 0x7fc9c0070ed0 2024-09-16T06:46:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9c54df640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0147660 con 0x7fc9c006fa90 2024-09-16T06:46:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9be7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006fa90 0x7fc9c006f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9bf7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc9c0070ed0 0x7fc9c0139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9bf7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc9c0070ed0 0x7fc9c0139c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59652/0 (socket says 172.21.15.96:59652) 2024-09-16T06:46:49.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9bf7fe640 1 -- 172.21.15.96:0/3707003544 learned_addr learned my addr 172.21.15.96:0/3707003544 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9be7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006fa90 0x7fc9c006f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56336/0 (socket says 172.21.15.96:56336) 2024-09-16T06:46:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9bf7fe640 1 -- 172.21.15.96:0/3707003544 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006fa90 msgr2=0x7fc9c006f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9bf7fe640 1 --2- 172.21.15.96:0/3707003544 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006fa90 0x7fc9c006f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9bf7fe640 1 -- 172.21.15.96:0/3707003544 >> v1:172.21.15.134:6789/0 conn(0x7fc9c006b700 legacy=0x7fc9c0146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:49.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:48.999+0000 7fc9bf7fe640 1 -- 172.21.15.96:0/3707003544 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0070390 con 0x7fc9c0070ed0 2024-09-16T06:46:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9bf7fe640 1 --2- 172.21.15.96:0/3707003544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c0070ed0 0x7fc9c0139c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009e50 tx=0x7fc9b001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b9875315e3c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9bdffb640 1 -- 172.21.15.96:0/3707003544 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00a5650 con 0x7fc9c0070ed0 2024-09-16T06:46:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9bdffb640 1 -- 172.21.15.96:0/3707003544 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b00a57b0 con 0x7fc9c0070ed0 2024-09-16T06:46:49.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9bdffb640 1 -- 172.21.15.96:0/3707003544 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00a5b40 con 0x7fc9c0070ed0 2024-09-16T06:46:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- 172.21.15.96:0/3707003544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c0070ed0 msgr2=0x7fc9c0139c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 --2- 172.21.15.96:0/3707003544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c0070ed0 0x7fc9c0139c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009e50 tx=0x7fc9b001c9d0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- 172.21.15.96:0/3707003544 shutdown_connections 2024-09-16T06:46:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 --2- 172.21.15.96:0/3707003544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c0070ed0 0x7fc9c0139c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 --2- 172.21.15.96:0/3707003544 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006fa90 0x7fc9c006f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- 172.21.15.96:0/3707003544 >> 172.21.15.96:0/3707003544 conn(0x7fc9c0072d40 msgr2=0x7fc9c0073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- 172.21.15.96:0/3707003544 shutdown_connections 2024-09-16T06:46:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- 172.21.15.96:0/3707003544 wait complete. 2024-09-16T06:46:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 Processor -- start 2024-09-16T06:46:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- start start 2024-09-16T06:46:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006b700 0x7fc9c00a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c006fa90 0x7fc9c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c0070ed0 0x7fc9c0099390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0143b40 con 0x7fc9c006fa90 2024-09-16T06:46:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0141760 con 0x7fc9c0070ed0 2024-09-16T06:46:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c0141990 con 0x7fc9c006b700 2024-09-16T06:46:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9beffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006b700 0x7fc9c00a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9be7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c006fa90 0x7fc9c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9beffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006b700 0x7fc9c00a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56350/0 (socket says 172.21.15.96:56350) 2024-09-16T06:46:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9beffd640 1 -- 172.21.15.96:0/2475114237 learned_addr learned my addr 172.21.15.96:0/2475114237 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9be7fc640 1 -- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006b700 msgr2=0x7fc9c00a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9be7fc640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006b700 0x7fc9c00a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9be7fc640 1 -- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c0070ed0 msgr2=0x7fc9c0099390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9be7fc640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c0070ed0 0x7fc9c0099390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9be7fc640 1 -- 172.21.15.96:0/2475114237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009b30 con 0x7fc9c006fa90 2024-09-16T06:46:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9beffd640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006b700 0x7fc9c00a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9be7fc640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c006fa90 0x7fc9c00a0e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400e870 tx=0x7fc9b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9a77fe640 1 -- 172.21.15.96:0/2475114237 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40095d0 con 0x7fc9c006fa90 2024-09-16T06:46:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9a77fe640 1 -- 172.21.15.96:0/2475114237 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400c940 con 0x7fc9c006fa90 2024-09-16T06:46:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c00a1340 con 0x7fc9c006fa90 2024-09-16T06:46:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9a77fe640 1 -- 172.21.15.96:0/2475114237 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400ccb0 con 0x7fc9c006fa90 2024-09-16T06:46:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.003+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c01443f0 con 0x7fc9c006fa90 2024-09-16T06:46:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c006f220 con 0x7fc9c006fa90 2024-09-16T06:46:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9a77fe640 1 -- 172.21.15.96:0/2475114237 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fc9b4013470 con 0x7fc9c006fa90 2024-09-16T06:46:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9a77fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9a77fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9a77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9a77fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9a77fe640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc9ac097840 0x7fc9ac099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9a77fe640 1 -- 172.21.15.96:0/2475114237 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fc9b40c05d0 con 0x7fc9c006fa90 2024-09-16T06:46:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9beffd640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc9ac097840 0x7fc9ac099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.007+0000 7fc9beffd640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc9ac097840 0x7fc9ac099d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8004470 tx=0x7fc9b8003700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.011+0000 7fc9a77fe640 1 -- 172.21.15.96:0/2475114237 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9b408dce0 con 0x7fc9c006fa90 2024-09-16T06:46:49.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.155+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9c0146fb0 con 0x7fc9c006fa90 2024-09-16T06:46:49.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9a77fe640 1 -- 172.21.15.96:0/2475114237 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7fc9b4017090 con 0x7fc9c006fa90 2024-09-16T06:46:49.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:49.163 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:49.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 10 mgrc shutdown 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc9ac097840 msgr2=0x7fc9ac099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc9ac097840 0x7fc9ac099d00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8004470 tx=0x7fc9b8003700 comp rx=0 tx=0).stop 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c006fa90 msgr2=0x7fc9c00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c006fa90 0x7fc9c00a0e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400e870 tx=0x7fc9b400ed30 comp rx=0 tx=0).stop 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 shutdown_connections 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fc9ac097840 0x7fc9ac099d00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9c006fa90 0x7fc9c00a0e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c0070ed0 0x7fc9c0099390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 --2- 172.21.15.96:0/2475114237 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9c006b700 0x7fc9c00a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 >> 172.21.15.96:0/2475114237 conn(0x7fc9c0072d40 msgr2=0x7fc9c0065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 shutdown_connections 2024-09-16T06:46:49.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.159+0000 7fc9c54df640 1 -- 172.21.15.96:0/2475114237 wait complete. 2024-09-16T06:46:49.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:46:49.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:46:49.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T06:46:26.589352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-16T06:46:31.515422+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 16, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T06:46:37.467661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T06:46:38.139243+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.190000057220459, 'score_stable': 1.190000057220459, 'optimal_score': 1, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T06:46:49.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T06:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88bfe0640 1 Processor -- start 2024-09-16T06:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88bfe0640 1 -- start start 2024-09-16T06:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88bfe0640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8840abe10 0x7fa8840aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88bfe0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88406b4d0 con 0x7fa8840ad710 2024-09-16T06:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88bfe0640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa884069df0 con 0x7fa884140a00 2024-09-16T06:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88bfe0640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88406a0b0 con 0x7fa8840abe10 2024-09-16T06:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88a57d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa8840ad710 0x7fa88414bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52536/0 (socket says 172.21.15.96:52536) 2024-09-16T06:46:49.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88a57d640 1 -- 172.21.15.96:0/3296789140 learned_addr learned my addr 172.21.15.96:0/3296789140 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa889d7c640 1 --2- 172.21.15.96:0/3296789140 >> v2:172.21.15.134:3300/0 conn(0x7fa8840abe10 0x7fa8840aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298528085 0 0) 0x7fa88406b4d0 con 0x7fa8840ad710 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa870003530 con 0x7fa8840ad710 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3198760447 0 0) 0x7fa870003530 con 0x7fa8840ad710 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 >> v2:172.21.15.134:3300/0 conn(0x7fa8840abe10 msgr2=0x7fa8840aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 --2- 172.21.15.96:0/3296789140 >> v2:172.21.15.134:3300/0 conn(0x7fa8840abe10 0x7fa8840aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 >> v1:172.21.15.134:6789/0 conn(0x7fa884140a00 legacy=0x7fa8840ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840ac790 con 0x7fa8840ad710 2024-09-16T06:46:49.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 633242010 0 0) 0x7fa87c001a00 con 0x7fa8840ad710 2024-09-16T06:46:49.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 >> v1:172.21.15.96:6789/0 conn(0x7fa8840ad710 legacy=0x7fa88414bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa870003980 0x7fa870003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8700047d0 0x7fa870004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700052b0 0x7fa87000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88406a0b0 con 0x7fa8700047d0 2024-09-16T06:46:49.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87000c180 con 0x7fa870003980 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87000c340 con 0x7fa8700052b0 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88957b640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8700047d0 0x7fa870004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88a57d640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700052b0 0x7fa87000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa889d7c640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa870003980 0x7fa870003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88957b640 1 -- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700052b0 msgr2=0x7fa87000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88957b640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700052b0 0x7fa87000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88957b640 1 -- 172.21.15.96:0/3296789140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa870003980 msgr2=0x7fa870003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88957b640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa870003980 0x7fa870003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88957b640 1 -- 172.21.15.96:0/3296789140 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870003530 con 0x7fa8700047d0 2024-09-16T06:46:49.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.383+0000 7fa88a57d640 1 -- 172.21.15.96:0/3296789140 reap_dead start 2024-09-16T06:46:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88957b640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8700047d0 0x7fa870004c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa874001750 tx=0x7fa87401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1370de62606d0591 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740052d0 con 0x7fa8700047d0 2024-09-16T06:46:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740a7050 con 0x7fa8700047d0 2024-09-16T06:46:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa888d7a640 1 -- 172.21.15.96:0/3296789140 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874003600 con 0x7fa8700047d0 2024-09-16T06:46:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8700047d0 msgr2=0x7fa870004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8700047d0 0x7fa870004c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa874001750 tx=0x7fa87401c3a0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- 172.21.15.96:0/3296789140 shutdown_connections 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/3296789140 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8700047d0 0x7fa870004c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- 172.21.15.96:0/3296789140 >> 172.21.15.96:0/3296789140 conn(0x7fa88406fa60 msgr2=0x7fa88406fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- 172.21.15.96:0/3296789140 shutdown_connections 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- 172.21.15.96:0/3296789140 wait complete. 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 Processor -- start 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- start start 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700047d0 0x7fa88413be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa88413a410 0x7fa8841d0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8840af410 0x7fa8841d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841dd640 con 0x7fa8840af410 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841dd900 con 0x7fa88413a410 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841ddbc0 con 0x7fa8700047d0 2024-09-16T06:46:49.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700047d0 0x7fa88413be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700047d0 0x7fa88413be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56376/0 (socket says 172.21.15.96:56376) 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 -- 172.21.15.96:0/1777205635 learned_addr learned my addr 172.21.15.96:0/1777205635 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88a57d640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8840af410 0x7fa8841d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88957b640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa88413a410 0x7fa8841d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 -- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa88413a410 msgr2=0x7fa8841d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa88413a410 0x7fa8841d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 -- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8840af410 msgr2=0x7fa8841d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8840af410 0x7fa8841d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 -- 172.21.15.96:0/1777205635 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8841dac20 con 0x7fa8700047d0 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa889d7c640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700047d0 0x7fa88413be00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa88000f5a0 tx=0x7fa88000f9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa87a7fc640 1 -- 172.21.15.96:0/1777205635 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880014870 con 0x7fa8700047d0 2024-09-16T06:46:49.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa87a7fc640 1 -- 172.21.15.96:0/1777205635 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800149d0 con 0x7fa8700047d0 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88413c690 con 0x7fa8700047d0 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa87a7fc640 1 -- 172.21.15.96:0/1777205635 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880014d80 con 0x7fa8700047d0 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.387+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8841dd100 con 0x7fa8700047d0 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa884145260 con 0x7fa8700047d0 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa87a7fc640 1 -- 172.21.15.96:0/1777205635 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fa880015410 con 0x7fa8700047d0 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa87a7fc640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa87a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa87a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:49.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa87a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa87a7fc640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa868097870 0x7fa868099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa87a7fc640 1 -- 172.21.15.96:0/1777205635 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fa8800c0ce0 con 0x7fa8700047d0 2024-09-16T06:46:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.391+0000 7fa88957b640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa868097870 0x7fa868099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.395+0000 7fa88957b640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa868097870 0x7fa868099d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa870004750 tx=0x7fa874001130 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.395+0000 7fa87a7fc640 1 -- 172.21.15.96:0/1777205635 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa88008e3f0 con 0x7fa8700047d0 2024-09-16T06:46:49.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.555+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8840aae70 con 0x7fa8700047d0 2024-09-16T06:46:49.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.555+0000 7fa87a7fc640 1 -- 172.21.15.96:0/1777205635 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa880090320 con 0x7fa8700047d0 2024-09-16T06:46:49.560 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 10 mgrc shutdown 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa868097870 msgr2=0x7fa868099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa868097870 0x7fa868099d30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa870004750 tx=0x7fa874001130 comp rx=0 tx=0).stop 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700047d0 msgr2=0x7fa88413be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700047d0 0x7fa88413be00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa88000f5a0 tx=0x7fa88000f9a0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 shutdown_connections 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fa868097870 0x7fa868099d30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8840af410 0x7fa8841d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa88413a410 0x7fa8841d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 --2- 172.21.15.96:0/1777205635 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa8700047d0 0x7fa88413be00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 >> 172.21.15.96:0/1777205635 conn(0x7fa88406fa60 msgr2=0x7fa884141b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 shutdown_connections 2024-09-16T06:46:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.559+0000 7fa88bfe0640 1 -- 172.21.15.96:0/1777205635 wait complete. 2024-09-16T06:46:49.579 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-16T06:46:49.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.695+0000 7fd7d90b3640 1 Processor -- start 2024-09-16T06:46:49.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d90b3640 1 -- start start 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d90b3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7d4133610 0x7fd7d40a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d90b3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d40a6fe0 0x7fd7d406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d90b3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40a3970 con 0x7fd7d4136b30 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d90b3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d4132e60 con 0x7fd7d4133610 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d90b3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d4132b30 con 0x7fd7d40a6fe0 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7ca59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d40a6fe0 0x7fd7d406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d2d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7d4133610 0x7fd7d40a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d2d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7d4133610 0x7fd7d40a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59674/0 (socket says 172.21.15.96:59674) 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7ca59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d40a6fe0 0x7fd7d406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56378/0 (socket says 172.21.15.96:56378) 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d359e640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd7d4136b30 0x7fd7d4069ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52538/0 (socket says 172.21.15.96:52538) 2024-09-16T06:46:49.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d2d9d640 1 -- 172.21.15.96:0/1732997950 learned_addr learned my addr 172.21.15.96:0/1732997950 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:49.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7ca59c640 1 -- 172.21.15.96:0/1732997950 >> v2:172.21.15.96:3300/0 conn(0x7fd7d4133610 msgr2=0x7fd7d40a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:49.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7ca59c640 1 --2- 172.21.15.96:0/1732997950 >> v2:172.21.15.96:3300/0 conn(0x7fd7d4133610 0x7fd7d40a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7ca59c640 1 -- 172.21.15.96:0/1732997950 >> v1:172.21.15.96:6789/0 conn(0x7fd7d4136b30 legacy=0x7fd7d4069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7ca59c640 1 -- 172.21.15.96:0/1732997950 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d41339f0 con 0x7fd7d40a6fe0 2024-09-16T06:46:49.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d259c640 1 -- 172.21.15.96:0/1732997950 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753632988 0 0) 0x7fd7d40a3970 con 0x7fd7d4136b30 2024-09-16T06:46:49.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d2d9d640 1 --2- 172.21.15.96:0/1732997950 >> v2:172.21.15.96:3300/0 conn(0x7fd7d4133610 0x7fd7d40a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:49.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7ca59c640 1 --2- 172.21.15.96:0/1732997950 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d40a6fe0 0x7fd7d406d620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097c0 tx=0x7fd7bc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95d07e54ff00ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d259c640 1 -- 172.21.15.96:0/1732997950 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0ab600 con 0x7fd7d40a6fe0 2024-09-16T06:46:49.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d259c640 1 -- 172.21.15.96:0/1732997950 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0a7050 con 0x7fd7d40a6fe0 2024-09-16T06:46:49.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.699+0000 7fd7d259c640 1 -- 172.21.15.96:0/1732997950 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0ab980 con 0x7fd7d40a6fe0 2024-09-16T06:46:49.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1732997950 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d40a6fe0 msgr2=0x7fd7d406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1732997950 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d40a6fe0 0x7fd7d406d620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097c0 tx=0x7fd7bc01c3f0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1732997950 shutdown_connections 2024-09-16T06:46:49.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1732997950 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d40a6fe0 0x7fd7d406d620 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1732997950 >> v2:172.21.15.96:3300/0 conn(0x7fd7d4133610 0x7fd7d40a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1732997950 >> 172.21.15.96:0/1732997950 conn(0x7fd7d40a4520 msgr2=0x7fd7d40a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:49.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1732997950 shutdown_connections 2024-09-16T06:46:49.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1732997950 wait complete. 2024-09-16T06:46:49.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 Processor -- start 2024-09-16T06:46:49.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- start start 2024-09-16T06:46:49.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d40a6fe0 0x7fd7d413edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d4133610 0x7fd7d4143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7d4136b30 0x7fd7d40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41447c0 con 0x7fd7d4136b30 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d4144230 con 0x7fd7d40a6fe0 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d41444f0 con 0x7fd7d4133610 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d4133610 0x7fd7d4143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d359e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7d4136b30 0x7fd7d40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d4133610 0x7fd7d4143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56390/0 (socket says 172.21.15.96:56390) 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 -- 172.21.15.96:0/1802705471 learned_addr learned my addr 172.21.15.96:0/1802705471 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 -- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d40a6fe0 msgr2=0x7fd7d413edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d40a6fe0 0x7fd7d413edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 -- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7d4136b30 msgr2=0x7fd7d40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7d4136b30 0x7fd7d40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 -- 172.21.15.96:0/1802705471 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40094d0 con 0x7fd7d4133610 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d359e640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7d4136b30 0x7fd7d40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7ca59c640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d4133610 0x7fd7d4143b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc01aaa0 tx=0x7fd7bc019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7cbfff640 1 -- 172.21.15.96:0/1802705471 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc006e20 con 0x7fd7d4133610 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7cbfff640 1 -- 172.21.15.96:0/1802705471 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc004030 con 0x7fd7d4133610 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc009420 con 0x7fd7d4133610 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7cbfff640 1 -- 172.21.15.96:0/1802705471 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0043a0 con 0x7fd7d4133610 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d40b3160 con 0x7fd7d4133610 2024-09-16T06:46:49.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.703+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d406d620 con 0x7fd7d4133610 2024-09-16T06:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7cbfff640 1 -- 172.21.15.96:0/1802705471 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fd7bc0b2040 con 0x7fd7d4133610 2024-09-16T06:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7cbfff640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:49.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:49.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7cbfff640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd7b4097840 0x7fd7b4099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:49.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7cbfff640 1 -- 172.21.15.96:0/1802705471 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fd7bc1597b0 con 0x7fd7d4133610 2024-09-16T06:46:49.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7d2d9d640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd7b4097840 0x7fd7b4099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:49.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.707+0000 7fd7d2d9d640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd7b4097840 0x7fd7b4099d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4006f50 tx=0x7fd7c4006ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:49.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.711+0000 7fd7cbfff640 1 -- 172.21.15.96:0/1802705471 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7bc126ec0 con 0x7fd7d4133610 2024-09-16T06:46:49.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.871+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7d40a3f70 con 0x7fd7d4133610 2024-09-16T06:46:49.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.871+0000 7fd7cbfff640 1 -- 172.21.15.96:0/1802705471 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7bc0bc0a0 con 0x7fd7d4133610 2024-09-16T06:46:49.875 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 10 mgrc shutdown 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd7b4097840 msgr2=0x7fd7b4099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd7b4097840 0x7fd7b4099d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4006f50 tx=0x7fd7c4006ea0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d4133610 msgr2=0x7fd7d4143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d4133610 0x7fd7d4143b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc01aaa0 tx=0x7fd7bc019190 comp rx=0 tx=0).stop 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 shutdown_connections 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fd7b4097840 0x7fd7b4099d00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7d4136b30 0x7fd7d40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7d4133610 0x7fd7d4143b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 --2- 172.21.15.96:0/1802705471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7d40a6fe0 0x7fd7d413edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 >> 172.21.15.96:0/1802705471 conn(0x7fd7d40a4520 msgr2=0x7fd7d40a6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 shutdown_connections 2024-09-16T06:46:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:49.875+0000 7fd7d90b3640 1 -- 172.21.15.96:0/1802705471 wait complete. 2024-09-16T06:46:49.894 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T06:46:50.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b66396640 1 Processor -- start 2024-09-16T06:46:50.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b66396640 1 -- start start 2024-09-16T06:46:50.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b66396640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1b6006ec90 0x7f1b6006e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b66396640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b60070f20 0x7f1b600a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b66396640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b600a7f10 con 0x7f1b6006fdf0 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b66396640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6006e790 con 0x7f1b6006ec90 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b66396640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60070350 con 0x7f1b60070f20 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1b6006ec90 0x7f1b6006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b60070f20 0x7f1b600a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1b6006ec90 0x7f1b6006e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59690/0 (socket says 172.21.15.96:59690) 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5ffff640 1 -- 172.21.15.96:0/2751283556 learned_addr learned my addr 172.21.15.96:0/2751283556 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5ffff640 1 -- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b60070f20 msgr2=0x7f1b600a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5ffff640 1 --2- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b60070f20 0x7f1b600a79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5ffff640 1 -- 172.21.15.96:0/2751283556 >> v1:172.21.15.134:6789/0 conn(0x7f1b6006fdf0 legacy=0x7f1b6013ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5ffff640 1 -- 172.21.15.96:0/2751283556 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60070610 con 0x7f1b6006ec90 2024-09-16T06:46:50.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.003+0000 7f1b5f7fe640 1 --2- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b60070f20 0x7f1b600a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5ffff640 1 --2- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006ec90 0x7f1b6006e120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009870 tx=0x7f1b5001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aea64a45941f45f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5effd640 1 -- 172.21.15.96:0/2751283556 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500ab650 con 0x7f1b6006ec90 2024-09-16T06:46:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5effd640 1 -- 172.21.15.96:0/2751283556 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b500ab7b0 con 0x7f1b6006ec90 2024-09-16T06:46:50.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5effd640 1 -- 172.21.15.96:0/2751283556 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500abb40 con 0x7f1b6006ec90 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006ec90 msgr2=0x7f1b6006e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 --2- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006ec90 0x7f1b6006e120 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009870 tx=0x7f1b5001c470 comp rx=0 tx=0).stop 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- 172.21.15.96:0/2751283556 shutdown_connections 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 --2- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b60070f20 0x7f1b600a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 --2- 172.21.15.96:0/2751283556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006ec90 0x7f1b6006e120 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- 172.21.15.96:0/2751283556 >> 172.21.15.96:0/2751283556 conn(0x7f1b600b60a0 msgr2=0x7f1b600b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- 172.21.15.96:0/2751283556 shutdown_connections 2024-09-16T06:46:50.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- 172.21.15.96:0/2751283556 wait complete. 2024-09-16T06:46:50.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 Processor -- start 2024-09-16T06:46:50.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- start start 2024-09-16T06:46:50.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b6006ec90 0x7f1b60143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006fdf0 0x7f1b601369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b60070f20 0x7f1b60140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600a2a80 con 0x7f1b6006fdf0 2024-09-16T06:46:50.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60144ca0 con 0x7f1b60070f20 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b66396640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60144f60 con 0x7f1b6006ec90 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006fdf0 0x7f1b601369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5ffff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b6006ec90 0x7f1b60143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006fdf0 0x7f1b601369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59704/0 (socket says 172.21.15.96:59704) 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 -- 172.21.15.96:0/441332101 learned_addr learned my addr 172.21.15.96:0/441332101 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 -- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b6006ec90 msgr2=0x7f1b60143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b6006ec90 0x7f1b60143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 -- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b60070f20 msgr2=0x7f1b60140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b64933640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b60070f20 0x7f1b60140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b60070f20 0x7f1b60140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5f7fe640 1 -- 172.21.15.96:0/441332101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54009420 con 0x7f1b6006fdf0 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.007+0000 7f1b5ffff640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b6006ec90 0x7f1b60143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5f7fe640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006fdf0 0x7f1b601369a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e980 tx=0x7f1b5400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 1 -- 172.21.15.96:0/441332101 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400ca00 con 0x7f1b6006fdf0 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 1 -- 172.21.15.96:0/441332101 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400cb60 con 0x7f1b6006fdf0 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b500094d0 con 0x7f1b6006fdf0 2024-09-16T06:46:50.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 1 -- 172.21.15.96:0/441332101 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b54013470 con 0x7f1b6006fdf0 2024-09-16T06:46:50.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6013c640 con 0x7f1b6006fdf0 2024-09-16T06:46:50.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b600a2bc0 con 0x7f1b6006fdf0 2024-09-16T06:46:50.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 1 -- 172.21.15.96:0/441332101 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f1b540135d0 con 0x7f1b6006fdf0 2024-09-16T06:46:50.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:50.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:50.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1b4c097840 0x7f1b4c099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5cff9640 1 -- 172.21.15.96:0/441332101 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7f1b540c0740 con 0x7f1b6006fdf0 2024-09-16T06:46:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.011+0000 7f1b5ffff640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1b4c097840 0x7f1b4c099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.015+0000 7f1b5ffff640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1b4c097840 0x7f1b4c099d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1b500af000 tx=0x7f1b500b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.015+0000 7f1b5cff9640 1 -- 172.21.15.96:0/441332101 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b5408de50 con 0x7f1b6006fdf0 2024-09-16T06:46:50.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.163+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b6006e120 con 0x7f1b6006fdf0 2024-09-16T06:46:50.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.163+0000 7f1b5cff9640 1 -- 172.21.15.96:0/441332101 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b54017020 con 0x7f1b6006fdf0 2024-09-16T06:46:50.168 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 10 mgrc shutdown 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1b4c097840 msgr2=0x7f1b4c099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1b4c097840 0x7f1b4c099d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1b500af000 tx=0x7f1b500b6040 comp rx=0 tx=0).stop 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006fdf0 msgr2=0x7f1b601369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006fdf0 0x7f1b601369a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400e980 tx=0x7f1b5400ee40 comp rx=0 tx=0).stop 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 shutdown_connections 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f1b4c097840 0x7f1b4c099d00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b6006fdf0 0x7f1b601369a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b60070f20 0x7f1b60140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 --2- 172.21.15.96:0/441332101 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1b6006ec90 0x7f1b60143590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 >> 172.21.15.96:0/441332101 conn(0x7f1b600b60a0 msgr2=0x7f1b60072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:50.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 shutdown_connections 2024-09-16T06:46:50.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.167+0000 7f1b66396640 1 -- 172.21.15.96:0/441332101 wait complete. 2024-09-16T06:46:50.185 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T06:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.291+0000 7ff1f0986640 1 Processor -- start 2024-09-16T06:46:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.291+0000 7ff1f0986640 1 -- start start 2024-09-16T06:46:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1f0986640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff1ec0a7600 0x7ff1ec13f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1f0986640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06abb0 con 0x7ff1ec06a7d0 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1f0986640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec0a7a30 con 0x7ff1ec0a5d50 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1f0986640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec13fb90 con 0x7ff1ec0a7600 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ea59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff1ec06a7d0 0x7ff1ec13ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52546/0 (socket says 172.21.15.96:52546) 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ea59c640 1 -- 172.21.15.96:0/393815244 learned_addr learned my addr 172.21.15.96:0/393815244 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 --2- 172.21.15.96:0/393815244 >> v2:172.21.15.134:3300/0 conn(0x7ff1ec0a7600 0x7ff1ec13f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790015444 0 0) 0x7ff1ec06abb0 con 0x7ff1ec06a7d0 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d4003530 con 0x7ff1ec06a7d0 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588620817 0 0) 0x7ff1d4003530 con 0x7ff1ec06a7d0 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 >> v2:172.21.15.134:3300/0 conn(0x7ff1ec0a7600 msgr2=0x7ff1ec13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 --2- 172.21.15.96:0/393815244 >> v2:172.21.15.134:3300/0 conn(0x7ff1ec0a7600 0x7ff1ec13f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 >> v1:172.21.15.134:6789/0 conn(0x7ff1ec0a5d50 legacy=0x7ff1ec148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec0a7c90 con 0x7ff1ec06a7d0 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 633242010 0 0) 0x7ff1dc001a00 con 0x7ff1ec06a7d0 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 >> v1:172.21.15.96:6789/0 conn(0x7ff1ec06a7d0 legacy=0x7ff1ec13ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1d4003980 0x7ff1d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d40047d0 0x7ff1d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d4005390 0x7ff1d400caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d400d310 con 0x7ff1d4005390 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d400d480 con 0x7ff1d4003980 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d400d640 con 0x7ff1d40047d0 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e9d9b640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d40047d0 0x7ff1d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d4005390 0x7ff1d400caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ea59c640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1d4003980 0x7ff1d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 -- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d40047d0 msgr2=0x7ff1d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d40047d0 0x7ff1d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 -- 172.21.15.96:0/393815244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1d4003980 msgr2=0x7ff1d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1d4003980 0x7ff1d4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 -- 172.21.15.96:0/393815244 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4003530 con 0x7ff1d4005390 2024-09-16T06:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e9d9b640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d40047d0 0x7ff1d4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 -- 172.21.15.96:0/393815244 reap_dead start 2024-09-16T06:46:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1ead9d640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d4005390 0x7ff1d400caa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400ba30 tx=0x7ff1e401c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf311244608b269b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4004220 con 0x7ff1d4005390 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4004380 con 0x7ff1d4005390 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.295+0000 7ff1e959a640 1 -- 172.21.15.96:0/393815244 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4003860 con 0x7ff1d4005390 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d4005390 msgr2=0x7ff1d400caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d4005390 0x7ff1d400caa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400ba30 tx=0x7ff1e401c6c0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/393815244 shutdown_connections 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 --2- 172.21.15.96:0/393815244 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1d4005390 0x7ff1d400caa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/393815244 >> 172.21.15.96:0/393815244 conn(0x7ff1ec0a4520 msgr2=0x7ff1ec0a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/393815244 shutdown_connections 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/393815244 wait complete. 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 Processor -- start 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- start start 2024-09-16T06:46:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d4005390 0x7ff1ec0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1ec14a490 0x7ff1ec138000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1ec14a8d0 0x7ff1ec138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b4d90 con 0x7ff1ec14a490 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06e0d0 con 0x7ff1ec14a8d0 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06e390 con 0x7ff1d4005390 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d4005390 0x7ff1ec0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d4005390 0x7ff1ec0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56430/0 (socket says 172.21.15.96:56430) 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1e9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1ec14a490 0x7ff1ec138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 -- 172.21.15.96:0/3805088494 learned_addr learned my addr 172.21.15.96:0/3805088494 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ead9d640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1ec14a8d0 0x7ff1ec138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 -- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1ec14a8d0 msgr2=0x7ff1ec138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1ec14a8d0 0x7ff1ec138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 -- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1ec14a490 msgr2=0x7ff1ec138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1ec14a490 0x7ff1ec138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 -- 172.21.15.96:0/3805088494 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec14b010 con 0x7ff1d4005390 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ead9d640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1ec14a8d0 0x7ff1ec138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1e9d9b640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1ec14a490 0x7ff1ec138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1ea59c640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d4005390 0x7ff1ec0b4770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0079e0 tx=0x7ff1dc00e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1daffd640 1 -- 172.21.15.96:0/3805088494 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc007ad0 con 0x7ff1d4005390 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1daffd640 1 -- 172.21.15.96:0/3805088494 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc00ee50 con 0x7ff1d4005390 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec14b2f0 con 0x7ff1d4005390 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1daffd640 1 -- 172.21.15.96:0/3805088494 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc013640 con 0x7ff1d4005390 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec1407b0 con 0x7ff1d4005390 2024-09-16T06:46:50.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.299+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec13fa90 con 0x7ff1d4005390 2024-09-16T06:46:50.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1daffd640 1 -- 172.21.15.96:0/3805088494 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7ff1dc0137a0 con 0x7ff1d4005390 2024-09-16T06:46:50.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1daffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:50.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1daffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:50.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1daffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1daffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1daffd640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff1cc097840 0x7ff1cc099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1daffd640 1 -- 172.21.15.96:0/3805088494 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7ff1dc0c0350 con 0x7ff1d4005390 2024-09-16T06:46:50.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1e9d9b640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff1cc097840 0x7ff1cc099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.303+0000 7ff1e9d9b640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff1cc097840 0x7ff1cc099d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec06e6d0 tx=0x7ff1e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.307+0000 7ff1daffd640 1 -- 172.21.15.96:0/3805088494 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1dc08da60 con 0x7ff1d4005390 2024-09-16T06:46:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1ec0b4ed0 con 0x7ff1d4005390 2024-09-16T06:46:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1daffd640 1 -- 172.21.15.96:0/3805088494 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1dc08f990 con 0x7ff1d4005390 2024-09-16T06:46:50.466 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-09-16T06:46:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 10 mgrc shutdown 2024-09-16T06:46:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff1cc097840 msgr2=0x7ff1cc099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff1cc097840 0x7ff1cc099d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec06e6d0 tx=0x7ff1e0009040 comp rx=0 tx=0).stop 2024-09-16T06:46:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d4005390 msgr2=0x7ff1ec0b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d4005390 0x7ff1ec0b4770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0079e0 tx=0x7ff1dc00e530 comp rx=0 tx=0).stop 2024-09-16T06:46:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 shutdown_connections 2024-09-16T06:46:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7ff1cc097840 0x7ff1cc099d00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1ec14a490 0x7ff1ec138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1ec14a8d0 0x7ff1ec138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 --2- 172.21.15.96:0/3805088494 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff1d4005390 0x7ff1ec0b4770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 >> 172.21.15.96:0/3805088494 conn(0x7ff1ec0a4520 msgr2=0x7ff1ec1431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 shutdown_connections 2024-09-16T06:46:50.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.463+0000 7ff1f0986640 1 -- 172.21.15.96:0/3805088494 wait complete. 2024-09-16T06:46:50.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T06:46:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.587+0000 7fb2243f7640 1 Processor -- start 2024-09-16T06:46:50.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.587+0000 7fb2243f7640 1 -- start start 2024-09-16T06:46:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb2243f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c0a5100 0x7fb21c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb2243f7640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb21c0a40e0 0x7fb21c144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb2243f7640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c1449e0 con 0x7fb21c137b20 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb2243f7640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21c0a54e0 con 0x7fb21c0a40e0 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb2243f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c06d7b0 con 0x7fb21c0a5100 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c0a5100 0x7fb21c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c0a5100 0x7fb21c06e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56442/0 (socket says 172.21.15.96:56442) 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 -- 172.21.15.96:0/1530840345 learned_addr learned my addr 172.21.15.96:0/1530840345 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 -- 172.21.15.96:0/1530840345 >> v2:172.21.15.134:3300/0 conn(0x7fb21c0a40e0 msgr2=0x7fb21c144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 --2- 172.21.15.96:0/1530840345 >> v2:172.21.15.134:3300/0 conn(0x7fb21c0a40e0 0x7fb21c144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 -- 172.21.15.96:0/1530840345 >> v1:172.21.15.134:6789/0 conn(0x7fb21c137b20 legacy=0x7fb21c133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 -- 172.21.15.96:0/1530840345 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c144c10 con 0x7fb21c0a5100 2024-09-16T06:46:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb222193640 1 --2- 172.21.15.96:0/1530840345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c0a5100 0x7fb21c06e7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009870 tx=0x7fb20c01c550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76a72f8bd9e146e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb221191640 1 -- 172.21.15.96:0/1530840345 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0ac600 con 0x7fb21c0a5100 2024-09-16T06:46:50.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb221191640 1 -- 172.21.15.96:0/1530840345 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c0a8050 con 0x7fb21c0a5100 2024-09-16T06:46:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb221191640 1 -- 172.21.15.96:0/1530840345 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0ac980 con 0x7fb21c0a5100 2024-09-16T06:46:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb2243f7640 1 -- 172.21.15.96:0/1530840345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c0a5100 msgr2=0x7fb21c06e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.591+0000 7fb2243f7640 1 --2- 172.21.15.96:0/1530840345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c0a5100 0x7fb21c06e7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009870 tx=0x7fb20c01c550 comp rx=0 tx=0).stop 2024-09-16T06:46:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- 172.21.15.96:0/1530840345 shutdown_connections 2024-09-16T06:46:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 --2- 172.21.15.96:0/1530840345 >> v2:172.21.15.134:3300/0 conn(0x7fb21c0a40e0 0x7fb21c144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 --2- 172.21.15.96:0/1530840345 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c0a5100 0x7fb21c06e7d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- 172.21.15.96:0/1530840345 >> 172.21.15.96:0/1530840345 conn(0x7fb21c06b8a0 msgr2=0x7fb21c0a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- 172.21.15.96:0/1530840345 shutdown_connections 2024-09-16T06:46:50.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- 172.21.15.96:0/1530840345 wait complete. 2024-09-16T06:46:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 Processor -- start 2024-09-16T06:46:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- start start 2024-09-16T06:46:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb21c0a40e0 0x7fb21c0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21c0a5100 0x7fb21c148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c137b20 0x7fb21c1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c148f90 con 0x7fb21c0a40e0 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c148cf0 con 0x7fb21c0a5100 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0b4130 con 0x7fb21c137b20 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c137b20 0x7fb21c1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222193640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb21c0a40e0 0x7fb21c0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c137b20 0x7fb21c1487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56448/0 (socket says 172.21.15.96:56448) 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 -- 172.21.15.96:0/3439560531 learned_addr learned my addr 172.21.15.96:0/3439560531 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb221992640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21c0a5100 0x7fb21c148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 -- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21c0a5100 msgr2=0x7fb21c148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21c0a5100 0x7fb21c148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 -- 172.21.15.96:0/3439560531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb21c0a40e0 msgr2=0x7fb21c0b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb21c0a40e0 0x7fb21c0b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 -- 172.21.15.96:0/3439560531 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0094d0 con 0x7fb21c137b20 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb221992640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21c0a5100 0x7fb21c148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb222994640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c137b20 0x7fb21c1487b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb21400ba10 tx=0x7fb21400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb212ffd640 1 -- 172.21.15.96:0/3439560531 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400cba0 con 0x7fb21c137b20 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb212ffd640 1 -- 172.21.15.96:0/3439560531 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21400cd00 con 0x7fb21c137b20 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c0b43b0 con 0x7fb21c137b20 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb212ffd640 1 -- 172.21.15.96:0/3439560531 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214014680 con 0x7fb21c137b20 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c147d70 con 0x7fb21c137b20 2024-09-16T06:46:50.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.595+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c144ed0 con 0x7fb21c137b20 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb212ffd640 1 -- 172.21.15.96:0/3439560531 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fb21401d3b0 con 0x7fb21c137b20 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb212ffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb212ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb212ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb212ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb212ffd640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb200097840 0x7fb200099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb212ffd640 1 -- 172.21.15.96:0/3439560531 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fb2140c03b0 con 0x7fb21c137b20 2024-09-16T06:46:50.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb222193640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb200097840 0x7fb200099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.599+0000 7fb222193640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb200097840 0x7fb200099d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0ae000 tx=0x7fb20c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.603+0000 7fb212ffd640 1 -- 172.21.15.96:0/3439560531 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb21408da20 con 0x7fb21c137b20 2024-09-16T06:46:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.779+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb21c0b5970 con 0x7fb21c137b20 2024-09-16T06:46:50.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.779+0000 7fb212ffd640 1 -- 172.21.15.96:0/3439560531 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7fb214019020 con 0x7fb21c137b20 2024-09-16T06:46:50.783 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:50.783 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6809/2274498401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2274498401},{"type":"v1","addr":"172.21.15.96:6809","nonce":2274498401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6811/2101624097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2101624097},{"type":"v1","addr":"172.21.15.96:6811","nonce":2101624097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T06:46:39.151294+0000","modified":"2024-09-16T06:46:41.789469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6827/3093802738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3093802738},{"type":"v1","addr":"172.21.15.134:6827","nonce":3093802738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-16T06:46:50.784 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 10 mgrc shutdown 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb200097840 msgr2=0x7fb200099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb200097840 0x7fb200099d00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0ae000 tx=0x7fb20c0a7000 comp rx=0 tx=0).stop 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c137b20 msgr2=0x7fb21c1487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c137b20 0x7fb21c1487b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb21400ba10 tx=0x7fb21400bed0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 shutdown_connections 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb200097840 0x7fb200099d00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb21c137b20 0x7fb21c1487b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb21c0a5100 0x7fb21c148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 --2- 172.21.15.96:0/3439560531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb21c0a40e0 0x7fb21c0b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 >> 172.21.15.96:0/3439560531 conn(0x7fb21c06b8a0 msgr2=0x7fb21c1344a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:50.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 shutdown_connections 2024-09-16T06:46:50.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.783+0000 7fb2243f7640 1 -- 172.21.15.96:0/3439560531 wait complete. 2024-09-16T06:46:50.801 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:46:50.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.903+0000 7feebd21f640 1 Processor -- start 2024-09-16T06:46:50.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.903+0000 7feebd21f640 1 -- start start 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb80a7bf0 0x7feeb80a8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feeb8148d60 0x7feeb814b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80a74e0 con 0x7feeb80a5140 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb81449b0 con 0x7feeb8148d60 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8143a40 con 0x7feeb80a7bf0 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb6d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb80a7bf0 0x7feeb80a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb759e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feeb8148d60 0x7feeb814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb6d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb80a7bf0 0x7feeb80a8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56450/0 (socket says 172.21.15.96:56450) 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb6d9d640 1 -- 172.21.15.96:0/2417814913 learned_addr learned my addr 172.21.15.96:0/2417814913 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb759e640 1 -- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb80a7bf0 msgr2=0x7feeb80a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb759e640 1 --2- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb80a7bf0 0x7feeb80a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb759e640 1 -- 172.21.15.96:0/2417814913 >> v1:172.21.15.134:6789/0 conn(0x7feeb80a5140 legacy=0x7feeb81442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:50.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb759e640 1 -- 172.21.15.96:0/2417814913 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80a3ad0 con 0x7feeb8148d60 2024-09-16T06:46:50.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb6d9d640 1 --2- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb80a7bf0 0x7feeb80a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:50.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb759e640 1 --2- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb8148d60 0x7feeb814b150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009d90 tx=0x7feeb001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bc09466d1d2b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb5d9b640 1 -- 172.21.15.96:0/2417814913 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00a5810 con 0x7feeb8148d60 2024-09-16T06:46:50.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb5d9b640 1 -- 172.21.15.96:0/2417814913 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00a5970 con 0x7feeb8148d60 2024-09-16T06:46:50.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feeb5d9b640 1 -- 172.21.15.96:0/2417814913 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00a5d00 con 0x7feeb8148d60 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb8148d60 msgr2=0x7feeb814b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 --2- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb8148d60 0x7feeb814b150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009d90 tx=0x7feeb001c880 comp rx=0 tx=0).stop 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- 172.21.15.96:0/2417814913 shutdown_connections 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 --2- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb8148d60 0x7feeb814b150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 --2- 172.21.15.96:0/2417814913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb80a7bf0 0x7feeb80a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- 172.21.15.96:0/2417814913 >> 172.21.15.96:0/2417814913 conn(0x7feeb806bb60 msgr2=0x7feeb80a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- 172.21.15.96:0/2417814913 shutdown_connections 2024-09-16T06:46:50.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.907+0000 7feebd21f640 1 -- 172.21.15.96:0/2417814913 wait complete. 2024-09-16T06:46:50.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 Processor -- start 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 -- start start 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb80a5140 0x7feeb8146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb80a7bf0 0x7feeb8145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb8148d60 0x7feeb8140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81476c0 con 0x7feeb80a5140 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80b3260 con 0x7feeb80a7bf0 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8135220 con 0x7feeb8148d60 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb80a5140 0x7feeb8146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb8148d60 0x7feeb8140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb8148d60 0x7feeb8140860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56454/0 (socket says 172.21.15.96:56454) 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 -- 172.21.15.96:0/2171624372 learned_addr learned my addr 172.21.15.96:0/2171624372 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:50.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb659c640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb80a7bf0 0x7feeb8145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 -- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb80a7bf0 msgr2=0x7feeb8145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb80a7bf0 0x7feeb8145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 -- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb80a5140 msgr2=0x7feeb8146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb80a5140 0x7feeb8146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 -- 172.21.15.96:0/2171624372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80094d0 con 0x7feeb8148d60 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb6d9d640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb80a5140 0x7feeb8146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feeb759e640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb8148d60 0x7feeb8140860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feeb00b0040 tx=0x7feeb0019620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7fee9f7fe640 1 -- 172.21.15.96:0/2171624372 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00adc00 con 0x7feeb8148d60 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7fee9f7fe640 1 -- 172.21.15.96:0/2171624372 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00add60 con 0x7feeb8148d60 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb0009a70 con 0x7feeb8148d60 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7fee9f7fe640 1 -- 172.21.15.96:0/2171624372 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00b7650 con 0x7feeb8148d60 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb81471c0 con 0x7feeb8148d60 2024-09-16T06:46:50.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb81469a0 con 0x7feeb8148d60 2024-09-16T06:46:50.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7fee9f7fe640 1 -- 172.21.15.96:0/2171624372 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7feeb00b4050 con 0x7feeb8148d60 2024-09-16T06:46:50.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.911+0000 7fee9f7fe640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7fee9f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7fee9f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7fee9f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7fee9f7fe640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feea4097840 0x7feea4099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7fee9f7fe640 1 -- 172.21.15.96:0/2171624372 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7feeb015b130 con 0x7feeb8148d60 2024-09-16T06:46:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7feeb6d9d640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feea4097840 0x7feea4099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:50.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7feeb6d9d640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feea4097840 0x7feea4099d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feea8006cb0 tx=0x7feea8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:50.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:50.915+0000 7fee9f7fe640 1 -- 172.21.15.96:0/2171624372 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feeb0128840 con 0x7feeb8148d60 2024-09-16T06:46:51.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.067+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeb81469a0 con 0x7feeb8148d60 2024-09-16T06:46:51.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.067+0000 7fee9f7fe640 1 -- 172.21.15.96:0/2171624372 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13505 (secure 0 0 0) 0x7feeb81469a0 con 0x7feeb8148d60 2024-09-16T06:46:51.072 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:51.072 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:46:39.363820+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:46:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 10 mgrc shutdown 2024-09-16T06:46:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feea4097840 msgr2=0x7feea4099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feea4097840 0x7feea4099d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feea8006cb0 tx=0x7feea8009240 comp rx=0 tx=0).stop 2024-09-16T06:46:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb8148d60 msgr2=0x7feeb8140860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb8148d60 0x7feeb8140860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feeb00b0040 tx=0x7feeb0019620 comp rx=0 tx=0).stop 2024-09-16T06:46:51.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 shutdown_connections 2024-09-16T06:46:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feea4097840 0x7feea4099d00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feeb8148d60 0x7feeb8140860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feeb80a7bf0 0x7feeb8145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 --2- 172.21.15.96:0/2171624372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feeb80a5140 0x7feeb8146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 >> 172.21.15.96:0/2171624372 conn(0x7feeb806bb60 msgr2=0x7feeb8148280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 shutdown_connections 2024-09-16T06:46:51.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.071+0000 7feebd21f640 1 -- 172.21.15.96:0/2171624372 wait complete. 2024-09-16T06:46:51.089 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T06:46:51.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb57ebe640 1 Processor -- start 2024-09-16T06:46:51.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb57ebe640 1 -- start start 2024-09-16T06:46:51.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb57ebe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5006efc0 0x7feb5014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb57ebe640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb50144ba0 con 0x7feb5013ebd0 2024-09-16T06:46:51.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb57ebe640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb500a4800 con 0x7feb5013efb0 2024-09-16T06:46:51.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb57ebe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb50144df0 con 0x7feb5006efc0 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb5645b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5006efc0 0x7feb5014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb55c5a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7feb5013ebd0 0x7feb500a40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:52552/0 (socket says 172.21.15.96:52552) 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb5645b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5006efc0 0x7feb5014ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56470/0 (socket says 172.21.15.96:56470) 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb55c5a640 1 -- 172.21.15.96:0/1187585702 learned_addr learned my addr 172.21.15.96:0/1187585702 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb5645b640 1 -- 172.21.15.96:0/1187585702 >> v1:172.21.15.134:6789/0 conn(0x7feb5013efb0 legacy=0x7feb5006e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb5645b640 1 -- 172.21.15.96:0/1187585702 >> v1:172.21.15.96:6789/0 conn(0x7feb5013ebd0 legacy=0x7feb500a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb54c58640 1 -- 172.21.15.96:0/1187585702 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632348354 0 0) 0x7feb50144ba0 con 0x7feb5013ebd0 2024-09-16T06:46:51.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.191+0000 7feb5645b640 1 -- 172.21.15.96:0/1187585702 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500a5ab0 con 0x7feb5006efc0 2024-09-16T06:46:51.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb5645b640 1 --2- 172.21.15.96:0/1187585702 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5006efc0 0x7feb5014ce40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb48009dc0 tx=0x7feb4801d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae5be320ebcc4a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb54c58640 1 -- 172.21.15.96:0/1187585702 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480a5790 con 0x7feb5006efc0 2024-09-16T06:46:51.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb54c58640 1 -- 172.21.15.96:0/1187585702 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb480a58f0 con 0x7feb5006efc0 2024-09-16T06:46:51.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb54c58640 1 -- 172.21.15.96:0/1187585702 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480a5c80 con 0x7feb5006efc0 2024-09-16T06:46:51.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- 172.21.15.96:0/1187585702 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5006efc0 msgr2=0x7feb5014ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 --2- 172.21.15.96:0/1187585702 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5006efc0 0x7feb5014ce40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb48009dc0 tx=0x7feb4801d330 comp rx=0 tx=0).stop 2024-09-16T06:46:51.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- 172.21.15.96:0/1187585702 shutdown_connections 2024-09-16T06:46:51.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 --2- 172.21.15.96:0/1187585702 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5006efc0 0x7feb5014ce40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- 172.21.15.96:0/1187585702 >> 172.21.15.96:0/1187585702 conn(0x7feb5006dfd0 msgr2=0x7feb5006b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- 172.21.15.96:0/1187585702 shutdown_connections 2024-09-16T06:46:51.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- 172.21.15.96:0/1187585702 wait complete. 2024-09-16T06:46:51.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 Processor -- start 2024-09-16T06:46:51.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- start start 2024-09-16T06:46:51.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5006efc0 0x7feb5013b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5013ebd0 0x7feb5013c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5013efb0 0x7feb5013ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5013d360 con 0x7feb5006efc0 2024-09-16T06:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb501367f0 con 0x7feb5013efb0 2024-09-16T06:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb50140f80 con 0x7feb5013ebd0 2024-09-16T06:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5013ebd0 0x7feb5013c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55c5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5006efc0 0x7feb5013b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5013ebd0 0x7feb5013c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56486/0 (socket says 172.21.15.96:56486) 2024-09-16T06:46:51.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 -- 172.21.15.96:0/3087805530 learned_addr learned my addr 172.21.15.96:0/3087805530 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:51.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 -- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5013efb0 msgr2=0x7feb5013ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5013efb0 0x7feb5013ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 -- 172.21.15.96:0/3087805530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5006efc0 msgr2=0x7feb5013b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5006efc0 0x7feb5013b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 -- 172.21.15.96:0/3087805530 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48009a70 con 0x7feb5013ebd0 2024-09-16T06:46:51.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb55459640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5013ebd0 0x7feb5013c8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb4000b3e0 tx=0x7feb4000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb467fc640 1 -- 172.21.15.96:0/3087805530 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40011830 con 0x7feb5013ebd0 2024-09-16T06:46:51.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb467fc640 1 -- 172.21.15.96:0/3087805530 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb400119b0 con 0x7feb5013ebd0 2024-09-16T06:46:51.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb50141200 con 0x7feb5013ebd0 2024-09-16T06:46:51.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb467fc640 1 -- 172.21.15.96:0/3087805530 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40011d60 con 0x7feb5013ebd0 2024-09-16T06:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.195+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb500a2280 con 0x7feb5013ebd0 2024-09-16T06:46:51.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb500a2560 con 0x7feb5013ebd0 2024-09-16T06:46:51.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb467fc640 1 -- 172.21.15.96:0/3087805530 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7feb4001a400 con 0x7feb5013ebd0 2024-09-16T06:46:51.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb467fc640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:51.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb467fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:51.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb467fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:51.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb467fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:51.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb467fc640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feb34097840 0x7feb34099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb467fc640 1 -- 172.21.15.96:0/3087805530 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7feb400c04e0 con 0x7feb5013ebd0 2024-09-16T06:46:51.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb55c5a640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feb34097840 0x7feb34099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.199+0000 7feb55c5a640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feb34097840 0x7feb34099d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb4c007fd0 tx=0x7feb4c007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.203+0000 7feb467fc640 1 -- 172.21.15.96:0/3087805530 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb4008dbf0 con 0x7feb5013ebd0 2024-09-16T06:46:51.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb500a40f0 con 0x7feb5013ebd0 2024-09-16T06:46:51.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb467fc640 1 -- 172.21.15.96:0/3087805530 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7feb40015090 con 0x7feb5013ebd0 2024-09-16T06:46:51.390 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:46:51.390 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6809/2274498401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2274498401},{"type":"v1","addr":"172.21.15.96:6809","nonce":2274498401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6811/2101624097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2101624097},{"type":"v1","addr":"172.21.15.96:6811","nonce":2101624097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T06:46:39.151294+0000","modified":"2024-09-16T06:46:41.789469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6827/3093802738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3093802738},{"type":"v1","addr":"172.21.15.134:6827","nonce":3093802738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-16T06:46:51.390 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 10 mgrc shutdown 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feb34097840 msgr2=0x7feb34099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feb34097840 0x7feb34099d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb4c007fd0 tx=0x7feb4c007d60 comp rx=0 tx=0).stop 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5013ebd0 msgr2=0x7feb5013c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5013ebd0 0x7feb5013c8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb4000b3e0 tx=0x7feb4000b8a0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 shutdown_connections 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7feb34097840 0x7feb34099d00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb5013efb0 0x7feb5013ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb5013ebd0 0x7feb5013c8e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 --2- 172.21.15.96:0/3087805530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5006efc0 0x7feb5013b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 >> 172.21.15.96:0/3087805530 conn(0x7feb5006dfd0 msgr2=0x7feb50144170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 shutdown_connections 2024-09-16T06:46:51.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.387+0000 7feb57ebe640 1 -- 172.21.15.96:0/3087805530 wait complete. 2024-09-16T06:46:51.708 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T06:46:39.151294+0000', 'modified': '2024-09-16T06:46:41.789469+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4240}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4240': {'gid': 4240, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6827/3093802738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3093802738}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3093802738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-16T06:46:51.708 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T06:46:51.709 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T06:46:51.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7fa461640 1 Processor -- start 2024-09-16T06:46:51.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7fa461640 1 -- start start 2024-09-16T06:46:51.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7fa461640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb7f41420c0 0x7fb7f406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7fa461640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40b3e00 0x7fb7f40a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7fa461640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40aa960 con 0x7fb7f40a87e0 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7fa461640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f40aac00 con 0x7fb7f41420c0 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7fa461640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40709f0 con 0x7fb7f40b3e00 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40b3e00 0x7fb7f40a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40b3e00 0x7fb7f40a82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56492/0 (socket says 172.21.15.96:56492) 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3305605150 learned_addr learned my addr 172.21.15.96:0/3305605150 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/3305605150 >> v2:172.21.15.134:3300/0 conn(0x7fb7f41420c0 0x7fb7f406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3305605150 >> v2:172.21.15.134:3300/0 conn(0x7fb7f41420c0 msgr2=0x7fb7f406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3305605150 >> v2:172.21.15.134:3300/0 conn(0x7fb7f41420c0 0x7fb7f406fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3305605150 >> v1:172.21.15.134:6789/0 conn(0x7fb7f40a87e0 legacy=0x7fb7f4144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.831+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3305605150 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f41424a0 con 0x7fb7f40b3e00 2024-09-16T06:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3305605150 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40b3e00 0x7fb7f40a82a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009870 tx=0x7fb7e801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d285b37347321a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7f2ffd640 1 -- 172.21.15.96:0/3305605150 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80ab600 con 0x7fb7f40b3e00 2024-09-16T06:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7f2ffd640 1 -- 172.21.15.96:0/3305605150 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80a7050 con 0x7fb7f40b3e00 2024-09-16T06:46:51.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7f2ffd640 1 -- 172.21.15.96:0/3305605150 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80ab980 con 0x7fb7f40b3e00 2024-09-16T06:46:51.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 -- 172.21.15.96:0/3305605150 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40b3e00 msgr2=0x7fb7f40a82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 --2- 172.21.15.96:0/3305605150 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40b3e00 0x7fb7f40a82a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009870 tx=0x7fb7e801c430 comp rx=0 tx=0).stop 2024-09-16T06:46:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 -- 172.21.15.96:0/3305605150 shutdown_connections 2024-09-16T06:46:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 --2- 172.21.15.96:0/3305605150 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40b3e00 0x7fb7f40a82a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 --2- 172.21.15.96:0/3305605150 >> v2:172.21.15.134:3300/0 conn(0x7fb7f41420c0 0x7fb7f406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 -- 172.21.15.96:0/3305605150 >> 172.21.15.96:0/3305605150 conn(0x7fb7f40b7b30 msgr2=0x7fb7f40b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 -- 172.21.15.96:0/3305605150 shutdown_connections 2024-09-16T06:46:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 -- 172.21.15.96:0/3305605150 wait complete. 2024-09-16T06:46:51.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 Processor -- start 2024-09-16T06:46:51.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.835+0000 7fb7fa461640 1 -- start start 2024-09-16T06:46:51.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40a87e0 0x7fb7f414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7f40b3e00 0x7fb7f41e0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7f41420c0 0x7fb7f41e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f414b510 con 0x7fb7f41420c0 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f406c900 con 0x7fb7f40b3e00 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f406e470 con 0x7fb7f40a87e0 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40a87e0 0x7fb7f414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40a87e0 0x7fb7f414ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56504/0 (socket says 172.21.15.96:56504) 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 -- 172.21.15.96:0/24843352 learned_addr learned my addr 172.21.15.96:0/24843352 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f89fe640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7f41420c0 0x7fb7f41e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7f40b3e00 0x7fb7f41e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 -- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7f40b3e00 msgr2=0x7fb7f41e0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7f40b3e00 0x7fb7f41e0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 -- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7f41420c0 msgr2=0x7fb7f41e09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7f41420c0 0x7fb7f41e09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 -- 172.21.15.96:0/24843352 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80094d0 con 0x7fb7f40a87e0 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40a87e0 0x7fb7f414ac30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400d800 tx=0x7fb7e400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 1 -- 172.21.15.96:0/24843352 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400b6c0 con 0x7fb7f40a87e0 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 1 -- 172.21.15.96:0/24843352 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400b820 con 0x7fb7f40a87e0 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f406cb30 con 0x7fb7f40a87e0 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 1 -- 172.21.15.96:0/24843352 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400bb90 con 0x7fb7f40a87e0 2024-09-16T06:46:51.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f414a260 con 0x7fb7f40a87e0 2024-09-16T06:46:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 1 -- 172.21.15.96:0/24843352 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7fb7e400bcf0 con 0x7fb7f40a87e0 2024-09-16T06:46:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:46:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fd5a8000 1 Processor -- start 2024-09-16T06:46:51.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7fd5a8000 1 -- start start 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.839+0000 7fb7f0ff9640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb7e0097840 0x7fb7e0099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f0ff9640 1 -- 172.21.15.96:0/24843352 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fb7e40c02c0 con 0x7fb7f40a87e0 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f89fe640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb7e0097840 0x7fb7e0099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9476da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d947398a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d94601b10 con 0x564d94739de0 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d94590aa0 con 0x564d9476d650 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d9458e070 con 0x564d9476df70 2024-09-16T06:46:51.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d947398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d947398a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56514/0 (socket says 172.21.15.96:56514) 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f89fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3476058406 learned_addr learned my addr 172.21.15.96:0/3476058406 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9476da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3476058406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 msgr2=0x564d9476da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9476da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3476058406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 msgr2=0x564d9473a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 -- 172.21.15.96:0/3476058406 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d94285730 con 0x564d9476df70 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9476da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d947398a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ae040 tx=0x7fb7e80a6000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1d0107edec316f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f89fe640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb7e0097840 0x7fb7e0099d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009fd0 tx=0x7fb7ec009ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7d9ffb640 1 -- 172.21.15.96:0/3476058406 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80ab800 con 0x564d9476df70 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7d9ffb640 1 -- 172.21.15.96:0/3476058406 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80ab960 con 0x564d9476df70 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7d9ffb640 1 -- 172.21.15.96:0/3476058406 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80abcd0 con 0x564d9476df70 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3476058406 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 msgr2=0x564d947398a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d947398a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80ae040 tx=0x7fb7e80a6000 comp rx=0 tx=0).stop 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3476058406 shutdown_connections 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d947398a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3476058406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9476da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3476058406 >> 172.21.15.96:0/3476058406 conn(0x564d947318d0 msgr2=0x564d94740710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3476058406 shutdown_connections 2024-09-16T06:46:51.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3476058406 wait complete. 2024-09-16T06:46:51.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- start start 2024-09-16T06:46:51.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 Processor -- start 2024-09-16T06:46:51.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9473e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d9473ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d94589960 con 0x564d94739de0 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d94528b70 con 0x564d9476d650 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d94546fd0 con 0x564d9476df70 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 10 client.0 _ll_register_callbacks cb 0x564d94725f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59788/0 (socket says 172.21.15.96:59788) 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 -- 172.21.15.96:0/3270027213 learned_addr learned my addr 172.21.15.96:0/3270027213 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f89fe640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d9473ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9473e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 -- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 msgr2=0x564d9473ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d9473ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 -- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 msgr2=0x564d9473e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9473e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 -- 172.21.15.96:0/3270027213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f41424a0 con 0x564d94739de0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f89fe640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d9473ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473e480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4099670 tx=0x7fb7e408f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9287f7d3ef8336 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/3270027213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4095370 con 0x564d94739de0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/3270027213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fb7e4095550 con 0x564d94739de0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.843+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d94586740 con 0x564d94739de0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/3270027213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7e40a91c0 con 0x564d94739de0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 10 client.4569 fetch_fsmap learned FSMap version 7 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564d9454eac0 con 0x564d94739de0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/3270027213 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d94586740 con 0x564d94739de0 2024-09-16T06:46:51.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/3270027213 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fb7e4099710 con 0x564d94739de0 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 10 client.4569 fetch_fsmap finished waiting for FSMap version 7 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 10 client.4569 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 20 client.4569 populate_metadata read hostname 'smithi096' 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9473f7a0 0x564d9477e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 4 client.4569 mds_command: new command op to 4240 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 --> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d945882b0 con 0x564d9473f7a0 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9473f7a0 0x564d9477e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7d2ffd640 10 client.4569 ms_handle_connect on v2:172.21.15.134:6826/3093802738 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9473f7a0 0x564d9477e0d0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54034129f384223 server_cookie=abc8a2525311e0bf in_seq=0 out_seq=0 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/3270027213 <== mds.0 v2:172.21.15.134:6826/3093802738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564d945882b0 con 0x564d9473f7a0 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7d2ffd640 10 client.4569 handle_command_reply: tid=0 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 client.4569 shutdown 2024-09-16T06:46:51.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 msgr2=0x564d9473e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473e480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4099670 tx=0x7fb7e408f9f0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 shutdown_connections 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476df70 0x564d9473ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9473e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9473f7a0 0x564d9477e0d0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/3270027213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9473e480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7d2ffd640 0 client.4569 ms_handle_reset on v2:172.21.15.134:6826/3093802738 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 >> 172.21.15.96:0/3270027213 conn(0x564d947318d0 msgr2=0x564d94738890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 shutdown_connections 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/3270027213 wait complete. 2024-09-16T06:46:51.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.847+0000 7fb7fd5a8000 20 client.4569 trim_cache size 0 max 16384 2024-09-16T06:46:51.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 Processor -- start 2024-09-16T06:46:51.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- start start 2024-09-16T06:46:51.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d947318d0 0x564d9477f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d94739de0 0x564d9477d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9477d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d94246940 con 0x564d947318d0 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d945887f0 con 0x564d9476d650 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d9452efd0 con 0x564d94739de0 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d94739de0 0x564d9477d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d94739de0 0x564d9477d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:56534/0 (socket says 172.21.15.96:56534) 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 -- 172.21.15.96:0/1713966143 learned_addr learned my addr 172.21.15.96:0/1713966143 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d947318d0 0x564d9477f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 -- 172.21.15.96:0/1713966143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 msgr2=0x564d9477d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9477d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 -- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d947318d0 msgr2=0x564d9477f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d947318d0 0x564d9477f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 -- 172.21.15.96:0/1713966143 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d94534c10 con 0x564d94739de0 2024-09-16T06:46:51.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d94739de0 0x564d9477d0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7e801aae0 tx=0x7fb7e80a8000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914774fb0f86a21e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7da7fc640 1 -- 172.21.15.96:0/1713966143 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8004480 con 0x564d94739de0 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7da7fc640 1 -- 172.21.15.96:0/1713966143 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e8006a70 con 0x564d94739de0 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7da7fc640 1 -- 172.21.15.96:0/1713966143 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80be5f0 con 0x564d94739de0 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d94739de0 msgr2=0x564d9477d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d94739de0 0x564d9477d0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7e801aae0 tx=0x7fb7e80a8000 comp rx=0 tx=0).stop 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/1713966143 shutdown_connections 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d9476d650 0x564d9477d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d94739de0 0x564d9477d0d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/1713966143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d947318d0 0x564d9477f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/1713966143 >> 172.21.15.96:0/1713966143 conn(0x564d94779510 msgr2=0x564d94738f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/1713966143 shutdown_connections 2024-09-16T06:46:51.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.863+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/1713966143 wait complete. 2024-09-16T06:46:51.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- start start 2024-09-16T06:46:51.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 Processor -- start 2024-09-16T06:46:51.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d947318d0 0x564d9477f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9479ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476d650 0x564d9479f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9458c4c0 con 0x564d94739de0 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d94559250 con 0x564d947318d0 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d94586cf0 con 0x564d9476d650 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 10 client.0 _ll_register_callbacks cb 0x564d94624e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9479ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9479ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:59808/0 (socket says 172.21.15.96:59808) 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 -- 172.21.15.96:0/2810659321 learned_addr learned my addr 172.21.15.96:0/2810659321 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f89fe640 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476d650 0x564d9479f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 -- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476d650 msgr2=0x564d9479f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476d650 0x564d9479f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 -- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d947318d0 msgr2=0x564d9477f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d947318d0 0x564d9477f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d947318d0 0x564d9477f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 -- 172.21.15.96:0/2810659321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e80bea90 con 0x564d94739de0 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f37fe640 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9479ec50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009870 tx=0x7fb7e801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a6c1bef55a1fbe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/2810659321 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80be3f0 con 0x564d94739de0 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/2810659321 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 4362+0+0 (secure 0 0 0) 0x7fb7e80be550 con 0x564d94739de0 2024-09-16T06:46:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d94559470 con 0x564d94739de0 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/2810659321 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7e80be730 con 0x564d94739de0 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 10 client.4575 fetch_fsmap learned FSMap version 7 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564d94285b60 con 0x564d94739de0 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/2810659321 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d94559470 con 0x564d94739de0 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/2810659321 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fb7e8003620 con 0x564d94739de0 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 10 client.4575 fetch_fsmap finished waiting for FSMap version 7 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 10 client.4575 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 20 client.4575 populate_metadata read hostname 'smithi096' 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9476df70 0x564d9479f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:46:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 4 client.4575 mds_command: new command op to 4240 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 --> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564d945b84a0 con 0x564d9476df70 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9476df70 0x564d9479f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 10 client.4575 ms_handle_connect on v2:172.21.15.134:6826/3093802738 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7f3fff640 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9476df70 0x564d9479f6d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f29f8380c26ad14c server_cookie=a7c633dfebd95809 in_seq=0 out_seq=0 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 1 -- 172.21.15.96:0/2810659321 <== mds.0 v2:172.21.15.134:6826/3093802738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x564d945b84a0 con 0x564d9476df70 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 10 client.4575 handle_command_reply: tid=0 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 client.4575 shutdown 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 msgr2=0x564d9479ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9479ec50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009870 tx=0x7fb7e801ac70 comp rx=0 tx=0).stop 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 shutdown_connections 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:6826/3093802738,v1:172.21.15.134:6827/3093802738] conn(0x564d9476df70 0x564d9479f6d0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564d94739de0 0x564d9479ec50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x564d9476d650 0x564d9479f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7d2ffd640 0 client.4575 ms_handle_reset on v2:172.21.15.134:6826/3093802738 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 --2- 172.21.15.96:0/2810659321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564d947318d0 0x564d9477f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 >> 172.21.15.96:0/2810659321 conn(0x564d94779510 msgr2=0x564d9477c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 shutdown_connections 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 1 -- 172.21.15.96:0/2810659321 wait complete. 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.867+0000 7fb7fd5a8000 20 client.4575 trim_cache size 0 max 16384 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "63031869-dae1-491e-928d-826cedeb9570", 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4240, 2024-09-16T06:46:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 12.717387168, 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 7, 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 20, 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 20, 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 17.114644231 2024-09-16T06:46:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-09-16T06:46:51.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 10 mgrc shutdown 2024-09-16T06:46:51.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb7e0097840 msgr2=0x7fb7e0099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb7e0097840 0x7fb7e0099d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009fd0 tx=0x7fb7ec009ae0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40a87e0 msgr2=0x7fb7f414ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:46:51.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40a87e0 0x7fb7f414ac30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400d800 tx=0x7fb7e400dcc0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 shutdown_connections 2024-09-16T06:46:51.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7fb7e0097840 0x7fb7e0099d00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7f41420c0 0x7fb7f41e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7f40b3e00 0x7fb7f41e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 --2- 172.21.15.96:0/24843352 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb7f40a87e0 0x7fb7f414ac30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:46:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 >> 172.21.15.96:0/24843352 conn(0x7fb7f40b7b30 msgr2=0x7fb7f40b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:46:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 shutdown_connections 2024-09-16T06:46:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:46:51.871+0000 7fb7fa461640 1 -- 172.21.15.96:0/24843352 wait complete. 2024-09-16T06:46:51.887 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T06:46:51.908 INFO:tasks.workunit:Pulling workunits from ref ae7f37330c1a72493684eb1fcaed6f2a01195bb6 2024-09-16T06:46:51.908 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T06:46:51.909 DEBUG:teuthology.orchestra.run.smithi096:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T06:46:51.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:46:51.913 INFO:teuthology.orchestra.run.smithi096.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T06:46:51.914 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T06:46:51.960 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T06:46:51.960 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T06:46:52.008 INFO:tasks.workunit:timeout=3h 2024-09-16T06:46:52.008 INFO:tasks.workunit:cleanup=True 2024-09-16T06:46:52.009 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ae7f37330c1a72493684eb1fcaed6f2a01195bb6 2024-09-16T06:46:52.057 INFO:tasks.workunit.client.0.smithi096.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T06:47:19.217 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:47:19.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:47:45.160 INFO:tasks.workunit.client.0.smithi096.stderr:Updating files: 98% (12677/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T06:47:45.708 INFO:tasks.workunit.client.0.smithi096.stderr:Note: switching to 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6'. 2024-09-16T06:47:45.708 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr: git switch -c 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr:Or undo this operation with: 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr: git switch - 2024-09-16T06:47:45.709 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T06:47:45.710 INFO:tasks.workunit.client.0.smithi096.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T06:47:45.710 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-09-16T06:47:45.710 INFO:tasks.workunit.client.0.smithi096.stderr:HEAD is now at ae7f37330c1 Merge pull request #59795 from zdover23/wip-doc-2024-09-15-backport-59613-to-reef 2024-09-16T06:47:45.716 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T06:47:45.722 INFO:tasks.workunit.client.0.smithi096.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T06:47:45.725 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T06:47:45.725 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T06:47:46.556 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T06:47:46.658 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T06:47:46.709 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T06:47:46.710 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T06:47:46.710 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T06:47:46.759 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T06:47:46.763 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-09-16T06:47:46.763 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T06:47:46.809 INFO:tasks.workunit:Running workunits matching mgr/test_localpool.sh on client.0... 2024-09-16T06:47:46.810 INFO:tasks.workunit:Running workunit mgr/test_localpool.sh... 2024-09-16T06:47:46.810 DEBUG:teuthology.orchestra.run.smithi096:workunit test mgr/test_localpool.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae7f37330c1a72493684eb1fcaed6f2a01195bb6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mgr/test_localpool.sh 2024-09-16T06:47:46.860 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mgr mgr/localpool/subtree host 2024-09-16T06:47:46.988 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.982+0000 7f2ae4e44640 1 Processor -- start 2024-09-16T06:47:46.988 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.982+0000 7f2ae4e44640 1 -- start start 2024-09-16T06:47:46.989 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae0073780 0x7f2ae006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:46.989 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2ae006e810 0x7f2ae0144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:46.989 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae0073b60 con 0x7f2ae006ec10 2024-09-16T06:47:46.989 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae006d850 con 0x7f2ae006e810 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0144c20 con 0x7f2ae0073780 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae0073780 0x7f2ae006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae0073780 0x7f2ae006d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:47278/0 (socket says 172.21.15.96:47278) 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 -- 172.21.15.96:0/4120810 learned_addr learned my addr 172.21.15.96:0/4120810 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2addd9b640 1 --2- 172.21.15.96:0/4120810 >> v2:172.21.15.96:3300/0 conn(0x7f2ae006e810 0x7f2ae0144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 -- 172.21.15.96:0/4120810 >> v2:172.21.15.96:3300/0 conn(0x7f2ae006e810 msgr2=0x7f2ae0144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 --2- 172.21.15.96:0/4120810 >> v2:172.21.15.96:3300/0 conn(0x7f2ae006e810 0x7f2ae0144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 -- 172.21.15.96:0/4120810 >> v1:172.21.15.96:6789/0 conn(0x7f2ae006ec10 legacy=0x7f2ae00b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 -- 172.21.15.96:0/4120810 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00a4280 con 0x7f2ae0073780 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2add59a640 1 -- 172.21.15.96:0/4120810 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420881662 0 0) 0x7f2ae0073b60 con 0x7f2ae006ec10 2024-09-16T06:47:46.990 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2addd9b640 1 --2- 172.21.15.96:0/4120810 >> v2:172.21.15.96:3300/0 conn(0x7f2ae006e810 0x7f2ae0144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:47:46.991 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ade59c640 1 --2- 172.21.15.96:0/4120810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae0073780 0x7f2ae006d310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009870 tx=0x7f2ad401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d128ac80460b05ae server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:46.991 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2add59a640 1 -- 172.21.15.96:0/4120810 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40ab640 con 0x7f2ae0073780 2024-09-16T06:47:46.991 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2add59a640 1 -- 172.21.15.96:0/4120810 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad40a7070 con 0x7f2ae0073780 2024-09-16T06:47:46.991 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2add59a640 1 -- 172.21.15.96:0/4120810 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40ab9c0 con 0x7f2ae0073780 2024-09-16T06:47:46.992 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- 172.21.15.96:0/4120810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae0073780 msgr2=0x7f2ae006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:46.992 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/4120810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae0073780 0x7f2ae006d310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009870 tx=0x7f2ad401c420 comp rx=0 tx=0).stop 2024-09-16T06:47:46.992 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- 172.21.15.96:0/4120810 shutdown_connections 2024-09-16T06:47:46.993 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/4120810 >> v2:172.21.15.96:3300/0 conn(0x7f2ae006e810 0x7f2ae0144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:46.993 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/4120810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae0073780 0x7f2ae006d310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:46.993 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- 172.21.15.96:0/4120810 >> 172.21.15.96:0/4120810 conn(0x7f2ae0069f80 msgr2=0x7f2ae0072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:46.993 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- 172.21.15.96:0/4120810 shutdown_connections 2024-09-16T06:47:46.993 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.986+0000 7f2ae4e44640 1 -- 172.21.15.96:0/4120810 wait complete. 2024-09-16T06:47:46.995 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 Processor -- start 2024-09-16T06:47:46.995 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 -- start start 2024-09-16T06:47:46.995 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae006e810 0x7f2ae00ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:46.995 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae006ec10 0x7f2ae00703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:46.995 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ae0073780 0x7f2ae01df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:46.995 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae006c8b0 con 0x7f2ae0073780 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00b47b0 con 0x7f2ae006e810 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00b4f10 con 0x7f2ae006ec10 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae006ec10 0x7f2ae00703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae006ec10 0x7f2ae00703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:47290/0 (socket says 172.21.15.96:47290) 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 -- 172.21.15.96:0/407437576 learned_addr learned my addr 172.21.15.96:0/407437576 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2aded9d640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ae0073780 0x7f2ae01df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 -- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae006e810 msgr2=0x7f2ae00ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae006e810 0x7f2ae00ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 -- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ae0073780 msgr2=0x7f2ae01df3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ae0073780 0x7f2ae01df3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 -- 172.21.15.96:0/407437576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009420 con 0x7f2ae006ec10 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2aded9d640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ae0073780 0x7f2ae01df3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:47:46.996 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2addd9b640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae006ec10 0x7f2ae00703c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000ebb0 tx=0x7f2ad000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:46.997 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000eeb0 con 0x7f2ae006ec10 2024-09-16T06:47:46.997 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000cc30 con 0x7f2ae006ec10 2024-09-16T06:47:46.997 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad40094d0 con 0x7f2ae006ec10 2024-09-16T06:47:46.997 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0013470 con 0x7f2ae006ec10 2024-09-16T06:47:46.997 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae0071300 con 0x7f2ae006ec10 2024-09-16T06:47:46.997 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.990+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae0144ee0 con 0x7f2ae006ec10 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f2ad00135d0 con 0x7f2ae006ec10 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2aceffd640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2aceffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2aceffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2aceffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2aceffd640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2ac0097870 0x7f2ac0099d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4479+0+0 (secure 0 0 0) 0x7f2ad00bffd0 con 0x7f2ae006ec10 2024-09-16T06:47:46.998 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2ade59c640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2ac0097870 0x7f2ac0099d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:46.999 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.994+0000 7f2ade59c640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2ac0097870 0x7f2ac0099d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40af000 tx=0x7f2ad4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:47.001 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:46.998+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ad008d700 con 0x7f2ae006ec10 2024-09-16T06:47:47.146 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.142+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command([{prefix=config set, name=mgr/localpool/subtree}] v 0) v1 -- 0x7f2ae0136f70 con 0x7f2ae006ec10 2024-09-16T06:47:47.156 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.150+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/subtree}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ad0090d20 con 0x7f2ae006ec10 2024-09-16T06:47:47.250 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.246+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command([{prefix=config set, name=mgr/localpool/subtree}] v 0) v1 -- 0x7f2ae00a2a40 con 0x7f2ae006ec10 2024-09-16T06:47:47.251 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.246+0000 7f2aceffd640 1 -- 172.21.15.96:0/407437576 <== mon.2 v2:172.21.15.96:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/subtree}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ad0021020 con 0x7f2ae006ec10 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 10 mgrc shutdown 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2ac0097870 msgr2=0x7f2ac0099d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2ac0097870 0x7f2ac0099d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40af000 tx=0x7f2ad4008040 comp rx=0 tx=0).stop 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae006ec10 msgr2=0x7f2ae00703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae006ec10 0x7f2ae00703c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000ebb0 tx=0x7f2ad000c520 comp rx=0 tx=0).stop 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 shutdown_connections 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f2ac0097870 0x7f2ac0099d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2ae0073780 0x7f2ae01df3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.254 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ae006ec10 0x7f2ae00703c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.255 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 --2- 172.21.15.96:0/407437576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ae006e810 0x7f2ae00ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.255 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 >> 172.21.15.96:0/407437576 conn(0x7f2ae0069f80 msgr2=0x7f2ae00a4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:47.255 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 shutdown_connections 2024-09-16T06:47:47.255 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.250+0000 7f2ae4e44640 1 -- 172.21.15.96:0/407437576 wait complete. 2024-09-16T06:47:47.270 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config set mgr mgr/localpool/failure_domain osd 2024-09-16T06:47:47.389 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3eec033640 1 Processor -- start 2024-09-16T06:47:47.390 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3eec033640 1 -- start start 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3eec033640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ee4066310 0x7f3ee4147250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3eec033640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee40a7360 0x7f3ee40a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3eec033640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee4143490 con 0x7f3ee4147790 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3eec033640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee4146d00 con 0x7f3ee4066310 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3eec033640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4146fa0 con 0x7f3ee40a7360 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee95ce640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee40a7360 0x7f3ee40a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee95ce640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee40a7360 0x7f3ee40a65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:47292/0 (socket says 172.21.15.96:47292) 2024-09-16T06:47:47.391 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee95ce640 1 -- 172.21.15.96:0/1663502239 learned_addr learned my addr 172.21.15.96:0/1663502239 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee9dcf640 1 --2- 172.21.15.96:0/1663502239 >> v2:172.21.15.134:3300/0 conn(0x7f3ee4066310 0x7f3ee4147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee95ce640 1 -- 172.21.15.96:0/1663502239 >> v2:172.21.15.134:3300/0 conn(0x7f3ee4066310 msgr2=0x7f3ee4147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee95ce640 1 --2- 172.21.15.96:0/1663502239 >> v2:172.21.15.134:3300/0 conn(0x7f3ee4066310 0x7f3ee4147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee95ce640 1 -- 172.21.15.96:0/1663502239 >> v1:172.21.15.96:6789/0 conn(0x7f3ee4147790 legacy=0x7f3ee40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee95ce640 1 -- 172.21.15.96:0/1663502239 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4070f90 con 0x7f3ee40a7360 2024-09-16T06:47:47.392 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.386+0000 7f3ee9dcf640 1 --2- 172.21.15.96:0/1663502239 >> v2:172.21.15.134:3300/0 conn(0x7f3ee4066310 0x7f3ee4147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:47:47.393 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee95ce640 1 --2- 172.21.15.96:0/1663502239 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee40a7360 0x7f3ee40a65f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009870 tx=0x7f3edc01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b161879a2e97c3a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:47.393 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee8dcd640 1 -- 172.21.15.96:0/1663502239 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0ab600 con 0x7f3ee40a7360 2024-09-16T06:47:47.393 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee8dcd640 1 -- 172.21.15.96:0/1663502239 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc0a7050 con 0x7f3ee40a7360 2024-09-16T06:47:47.393 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee8dcd640 1 -- 172.21.15.96:0/1663502239 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0ab980 con 0x7f3ee40a7360 2024-09-16T06:47:47.394 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- 172.21.15.96:0/1663502239 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee40a7360 msgr2=0x7f3ee40a65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.394 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 --2- 172.21.15.96:0/1663502239 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee40a7360 0x7f3ee40a65f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009870 tx=0x7f3edc01c540 comp rx=0 tx=0).stop 2024-09-16T06:47:47.394 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- 172.21.15.96:0/1663502239 shutdown_connections 2024-09-16T06:47:47.394 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 --2- 172.21.15.96:0/1663502239 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee40a7360 0x7f3ee40a65f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.394 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 --2- 172.21.15.96:0/1663502239 >> v2:172.21.15.134:3300/0 conn(0x7f3ee4066310 0x7f3ee4147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.395 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- 172.21.15.96:0/1663502239 >> 172.21.15.96:0/1663502239 conn(0x7f3ee4072e10 msgr2=0x7f3ee4073220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:47.395 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- 172.21.15.96:0/1663502239 shutdown_connections 2024-09-16T06:47:47.395 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- 172.21.15.96:0/1663502239 wait complete. 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 Processor -- start 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- start start 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee4066310 0x7f3ee413e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee40a7360 0x7f3ee4149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee4147790 0x7f3ee409eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee413ee40 con 0x7f3ee40a7360 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee4149570 con 0x7f3ee4147790 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eec033640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee409fe70 con 0x7f3ee4066310 2024-09-16T06:47:47.397 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee4066310 0x7f3ee413e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee4066310 0x7f3ee413e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:47294/0 (socket says 172.21.15.96:47294) 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 -- 172.21.15.96:0/3684439732 learned_addr learned my addr 172.21.15.96:0/3684439732 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee95ce640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee40a7360 0x7f3ee4149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3eea5d0640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee4147790 0x7f3ee409eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 -- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee4147790 msgr2=0x7f3ee409eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee4147790 0x7f3ee409eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 -- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee40a7360 msgr2=0x7f3ee4149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee40a7360 0x7f3ee4149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee9dcf640 1 -- 172.21.15.96:0/3684439732 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0094d0 con 0x7f3ee4066310 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.390+0000 7f3ee95ce640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee40a7360 0x7f3ee4149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3ee9dcf640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee4066310 0x7f3ee413e900 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000cf90 tx=0x7f3ee000a7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000d840 con 0x7f3ee4066310 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee000d9a0 con 0x7f3ee4066310 2024-09-16T06:47:47.398 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000dd30 con 0x7f3ee4066310 2024-09-16T06:47:47.399 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee409e490 con 0x7f3ee4066310 2024-09-16T06:47:47.399 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee41485d0 con 0x7f3ee4066310 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee406b4a0 con 0x7f3ee4066310 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f3ee0015440 con 0x7f3ee4066310 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3ec8097840 0x7f3ec8099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4479+0+0 (secure 0 0 0) 0x7f3ee00c0e90 con 0x7f3ee4066310 2024-09-16T06:47:47.400 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.394+0000 7f3ee95ce640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3ec8097840 0x7f3ec8099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.401 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.398+0000 7f3ee95ce640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3ec8097840 0x7f3ec8099d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0ad000 tx=0x7f3edc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:47.402 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.398+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ee008e670 con 0x7f3ee4066310 2024-09-16T06:47:47.561 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.558+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command([{prefix=config set, name=mgr/localpool/failure_domain}] v 0) v1 -- 0x7f3ee41496e0 con 0x7f3ee4066310 2024-09-16T06:47:47.568 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.566+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/failure_domain}]=0 v7)=0 v7) v1 ==== 128+0+0 (secure 0 0 0) 0x7f3ee001a0c0 con 0x7f3ee4066310 2024-09-16T06:47:47.664 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.658+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command([{prefix=config set, name=mgr/localpool/failure_domain}] v 0) v1 -- 0x7f3ee4147250 con 0x7f3ee4066310 2024-09-16T06:47:47.665 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eda7fc640 1 -- 172.21.15.96:0/3684439732 <== mon.2 v2:172.21.15.96:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mgr/localpool/failure_domain}]=0 v7)=0 v7) v1 ==== 128+0+0 (secure 0 0 0) 0x7f3ee0024020 con 0x7f3ee4066310 2024-09-16T06:47:47.667 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 10 mgrc shutdown 2024-09-16T06:47:47.667 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3ec8097840 msgr2=0x7f3ec8099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.667 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3ec8097840 0x7f3ec8099d00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0ad000 tx=0x7f3edc008040 comp rx=0 tx=0).stop 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee4066310 msgr2=0x7f3ee413e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee4066310 0x7f3ee413e900 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000cf90 tx=0x7f3ee000a7d0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 shutdown_connections 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f3ec8097840 0x7f3ec8099d00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee40a7360 0x7f3ee4149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ee4147790 0x7f3ee409eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 --2- 172.21.15.96:0/3684439732 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ee4066310 0x7f3ee413e900 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 >> 172.21.15.96:0/3684439732 conn(0x7f3ee4072e10 msgr2=0x7f3ee4145eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 shutdown_connections 2024-09-16T06:47:47.668 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.662+0000 7f3eec033640 1 -- 172.21.15.96:0/3684439732 wait complete. 2024-09-16T06:47:47.683 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph mgr module enable localpool 2024-09-16T06:47:47.800 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.794+0000 7f5bd26fe640 1 Processor -- start 2024-09-16T06:47:47.800 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.794+0000 7f5bd26fe640 1 -- start start 2024-09-16T06:47:47.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5bcc0a3f70 0x7f5bcc13ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5bcc0b51f0 0x7f5bcc13f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc071660 con 0x7f5bcc0a62b0 2024-09-16T06:47:47.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0b59f0 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0b5730 con 0x7f5bcc0a3f70 2024-09-16T06:47:47.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5bcc0b51f0 0x7f5bcc13f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.801 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5bcc0b51f0 0x7f5bcc13f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38740/0 (socket says 172.21.15.96:38740) 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bcbfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5bcc0a62b0 0x7f5bcc0a74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51160/0 (socket says 172.21.15.96:51160) 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/1226514698 learned_addr learned my addr 172.21.15.96:0/1226514698 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bcb7fe640 1 --2- 172.21.15.96:0/1226514698 >> v2:172.21.15.134:3300/0 conn(0x7f5bcc0a3f70 0x7f5bcc13ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/1226514698 >> v2:172.21.15.134:3300/0 conn(0x7f5bcc0a3f70 msgr2=0x7f5bcc13ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 --2- 172.21.15.96:0/1226514698 >> v2:172.21.15.134:3300/0 conn(0x7f5bcc0a3f70 0x7f5bcc13ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/1226514698 >> v1:172.21.15.96:6789/0 conn(0x7f5bcc0a62b0 legacy=0x7f5bcc0a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/1226514698 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0a34b0 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.802 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bcaffd640 1 -- 172.21.15.96:0/1226514698 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592573743 0 0) 0x7f5bcc071660 con 0x7f5bcc0a62b0 2024-09-16T06:47:47.803 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd0c9b640 1 --2- 172.21.15.96:0/1226514698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc13f270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0a2140 tx=0x7f5bc401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c682592c156dd59 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:47.803 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bcaffd640 1 -- 172.21.15.96:0/1226514698 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40a5710 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.803 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bcaffd640 1 -- 172.21.15.96:0/1226514698 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc40a5870 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.804 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bcaffd640 1 -- 172.21.15.96:0/1226514698 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40a5c00 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.804 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- 172.21.15.96:0/1226514698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 msgr2=0x7f5bcc13f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.804 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/1226514698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc13f270 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0a2140 tx=0x7f5bc401c940 comp rx=0 tx=0).stop 2024-09-16T06:47:47.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- 172.21.15.96:0/1226514698 shutdown_connections 2024-09-16T06:47:47.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/1226514698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc13f270 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/1226514698 >> v2:172.21.15.134:3300/0 conn(0x7f5bcc0a3f70 0x7f5bcc13ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- 172.21.15.96:0/1226514698 >> 172.21.15.96:0/1226514698 conn(0x7f5bcc069f80 msgr2=0x7f5bcc072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:47.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- 172.21.15.96:0/1226514698 shutdown_connections 2024-09-16T06:47:47.805 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.798+0000 7f5bd26fe640 1 -- 172.21.15.96:0/1226514698 wait complete. 2024-09-16T06:47:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 Processor -- start 2024-09-16T06:47:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 -- start start 2024-09-16T06:47:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bcc0a3f70 0x7f5bcc1475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bcc0a62b0 0x7f5bcc145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.807 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc146780 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc06f0a0 con 0x7f5bcc0a3f70 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc06f360 con 0x7f5bcc0a62b0 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bcc0a62b0 0x7f5bcc145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc146180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38748/0 (socket says 172.21.15.96:38748) 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/103129106 learned_addr learned my addr 172.21.15.96:0/103129106 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bcc0a3f70 0x7f5bcc1475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bcc0a62b0 msgr2=0x7f5bcc145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bcc0a62b0 0x7f5bcc145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bcc0a3f70 msgr2=0x7f5bcc1475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bcc0a3f70 0x7f5bcc1475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:47.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 -- 172.21.15.96:0/103129106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4009b30 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd0c9b640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc146180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40af040 tx=0x7f5bc40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40b4640 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc40b8070 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc070600 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.809 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40b4a00 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc147cc0 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.802+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc0a74c0 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 128877+0+0 (secure 0 0 0) 0x7f5bc40b4b60 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bc8ff9640 20 mgrc handle_mgr_map mgrmap(e 5) v1 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bc8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bc8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bc8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bc8ff9640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bb8099d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4479+0+0 (secure 0 0 0) 0x7f5bc415c870 con 0x7f5bcc0b51f0 2024-09-16T06:47:47.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bb8099d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:47.811 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.806+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bb8099d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc000f70 tx=0x7f5bbc007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:47.814 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:47.810+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5bc4129fa0 con 0x7f5bcc0b51f0 2024-09-16T06:47:48.013 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.010+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "localpool"} v 0) v1 -- 0x7f5bcc070ab0 con 0x7f5bcc0b51f0 2024-09-16T06:47:48.725 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.722+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 6) v1 ==== 128890+0+0 (secure 0 0 0) 0x7f5bc412a370 con 0x7f5bcc0b51f0 2024-09-16T06:47:48.725 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.722+0000 7f5bc8ff9640 20 mgrc handle_mgr_map mgrmap(e 6) v1 2024-09-16T06:47:48.726 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.722+0000 7f5bc8ff9640 4 mgrc handle_mgr_map Got map version 6 2024-09-16T06:47:48.726 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.722+0000 7f5bc8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:48.726 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.722+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "localpool"}]=0 v6) v1 ==== 88+0+0 (secure 0 0 0) 0x7f5bc40f03f0 con 0x7f5bcc0b51f0 2024-09-16T06:47:48.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bcbfff640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 msgr2=0x7f5bb8099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T06:47:48.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bcbfff640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 msgr2=0x7f5bb8099d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T06:47:48.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bb8099d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc000f70 tx=0x7f5bbc007b60 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:47:48.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bb8099d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc000f70 tx=0x7f5bbc007b60 comp rx=0 tx=0).stop 2024-09-16T06:47:48.747 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bc8ff9640 4 mgrc ms_handle_reset ms_handle_reset con 0x7f5bb8097840 2024-09-16T06:47:48.748 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bc8ff9640 4 mgrc reconnect Terminating session with v2:172.21.15.134:6824/468510839 2024-09-16T06:47:48.748 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 msgr2=0x7f5bb8099d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T06:47:48.748 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bc8ff9640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bb8099d00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:48.748 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.742+0000 7f5bc8ff9640 4 mgrc reconnect waiting to retry connect until 707.405468s 2024-09-16T06:47:48.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.806+0000 7f5bb2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:48.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.806+0000 7f5bb2ffd640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bcc1db0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:48.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.806+0000 7f5bcbfff640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 msgr2=0x7f5bcc1db0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/468510839 2024-09-16T06:47:48.810 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.806+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bcc1db0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:47:48.842 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:48.838+0000 7feba1c32180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:47:48.849 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:48.848+0000 7f06be915180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:47:48.849 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:48.848+0000 7faf4d615180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:47:48.864 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:48.858+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "localpool"} v 0) v1 -- 0x7f5ba4005070 con 0x7f5bcc0b51f0 2024-09-16T06:47:49.012 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.010+0000 7f5bcbfff640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 msgr2=0x7f5bcc1db0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/468510839 2024-09-16T06:47:49.013 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.010+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bcc1db0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:47:49.223 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:49.224+0000 7f06be915180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:47:49.227 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:49.222+0000 7feba1c32180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:47:49.228 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:49.228+0000 7faf4d615180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:47:49.322 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:47:49.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:47:49.356 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:49.356+0000 7f06be915180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:47:49.356 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:49.350+0000 7feba1c32180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:47:49.361 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:49.360+0000 7faf4d615180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:47:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.414+0000 7f5bcbfff640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 msgr2=0x7f5bcc1db0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/468510839 2024-09-16T06:47:49.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.414+0000 7f5bcbfff640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bcc1db0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T06:47:49.733 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.730+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 9 ==== mgrmap(e 7) v1 ==== 128890+0+0 (secure 0 0 0) 0x7f5bc415b2c0 con 0x7f5bcc0b51f0 2024-09-16T06:47:49.734 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.730+0000 7f5bc8ff9640 20 mgrc handle_mgr_map mgrmap(e 7) v1 2024-09-16T06:47:49.735 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.730+0000 7f5bc8ff9640 4 mgrc handle_mgr_map Got map version 7 2024-09-16T06:47:49.735 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.730+0000 7f5bc8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:49.735 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.730+0000 7f5bc8ff9640 1 -- 172.21.15.96:0/103129106 <== mon.0 v2:172.21.15.96:3300/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "localpool"}]=0 module 'localpool' is already enabled v7) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5bc412a730 con 0x7f5bcc0b51f0 2024-09-16T06:47:49.735 INFO:tasks.workunit.client.0.smithi096.stderr:module 'localpool' is already enabled 2024-09-16T06:47:49.737 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 10 mgrc shutdown 2024-09-16T06:47:49.737 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 msgr2=0x7f5bcc1db0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bcc1db0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 msgr2=0x7f5bcc146180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc146180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40af040 tx=0x7f5bc40196e0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 shutdown_connections 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7f5bb8097840 0x7f5bcc1db0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5bcc0b51f0 0x7f5bcc146180 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bcc0a62b0 0x7f5bcc145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 --2- 172.21.15.96:0/103129106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bcc0a3f70 0x7f5bcc1475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 >> 172.21.15.96:0/103129106 conn(0x7f5bcc069f80 msgr2=0x7f5bcc0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 shutdown_connections 2024-09-16T06:47:49.738 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.734+0000 7f5bd26fe640 1 -- 172.21.15.96:0/103129106 wait complete. 2024-09-16T06:47:49.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd pool ls 2024-09-16T06:47:49.753 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep ^by-host- 2024-09-16T06:47:49.771 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:49.766+0000 7feba1c32180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:49.781 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:49.780+0000 7f06be915180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:49.785 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:49.784+0000 7faf4d615180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:49.823 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:49.818+0000 7feba1c32180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:47:49.832 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:49.832+0000 7f06be915180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:47:49.836 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:49.836+0000 7faf4d615180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:47:49.865 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbf143640 1 Processor -- start 2024-09-16T06:47:49.865 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbf143640 1 -- start start 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbf143640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fafb81466b0 0x7fafb806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbf143640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb80a5e80 con 0x7fafb80a4570 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbf143640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb80a4ef0 con 0x7fafb80a79b0 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbf143640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb80a6c80 con 0x7fafb81466b0 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fafb80a4570 0x7fafb8145fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51186/0 (socket says 172.21.15.96:51186) 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 -- 172.21.15.96:0/4003920110 learned_addr learned my addr 172.21.15.96:0/4003920110 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920529609 0 0) 0x7fafb80a5e80 con 0x7fafb80a4570 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbd6e0640 1 --2- 172.21.15.96:0/4003920110 >> v2:172.21.15.134:3300/0 conn(0x7fafb81466b0 0x7fafb806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa4003530 con 0x7fafb80a4570 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1242929808 0 0) 0x7fafa4003530 con 0x7fafb80a4570 2024-09-16T06:47:49.868 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 >> v2:172.21.15.134:3300/0 conn(0x7fafb81466b0 msgr2=0x7fafb806aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 --2- 172.21.15.96:0/4003920110 >> v2:172.21.15.134:3300/0 conn(0x7fafb81466b0 0x7fafb806aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 >> v1:172.21.15.134:6789/0 conn(0x7fafb80a79b0 legacy=0x7fafb814bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb806a030 con 0x7fafb80a4570 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 633242010 0 0) 0x7fafa8001a00 con 0x7fafb80a4570 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 >> v1:172.21.15.96:6789/0 conn(0x7fafb80a4570 legacy=0x7fafb8145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafa40039f0 0x7fafa4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafa40047d0 0x7fafa4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa4005290 0x7fafa400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80a6c80 con 0x7fafa40039f0 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa400c1d0 con 0x7fafa4005290 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa400c390 con 0x7fafa40047d0 2024-09-16T06:47:49.869 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafa40039f0 0x7fafa4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafb7fff640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafa40047d0 0x7fafa4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbd6e0640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa4005290 0x7fafa400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 -- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafa40047d0 msgr2=0x7fafa4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafa40047d0 0x7fafa4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 -- 172.21.15.96:0/4003920110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa4005290 msgr2=0x7fafa400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa4005290 0x7fafa400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbcedf640 1 -- 172.21.15.96:0/4003920110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4003530 con 0x7fafa40039f0 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbd6e0640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa4005290 0x7fafa400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:47:49.870 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.862+0000 7fafbd6e0640 1 -- 172.21.15.96:0/4003920110 reap_dead start 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbcedf640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafa40039f0 0x7fafa4003e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fafa800a830 tx=0x7fafa801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfc12a4946937a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80072d0 con 0x7fafa40039f0 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa80a8070 con 0x7fafa40039f0 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb77fe640 1 -- 172.21.15.96:0/4003920110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80076f0 con 0x7fafa40039f0 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafa40039f0 msgr2=0x7fafa4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafa40039f0 0x7fafa4003e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fafa800a830 tx=0x7fafa801d300 comp rx=0 tx=0).stop 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- 172.21.15.96:0/4003920110 shutdown_connections 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 --2- 172.21.15.96:0/4003920110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafa40039f0 0x7fafa4003e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- 172.21.15.96:0/4003920110 >> 172.21.15.96:0/4003920110 conn(0x7fafb806d540 msgr2=0x7fafb806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- 172.21.15.96:0/4003920110 shutdown_connections 2024-09-16T06:47:49.875 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- 172.21.15.96:0/4003920110 wait complete. 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 Processor -- start 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- start start 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40039f0 0x7fafb80af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafb81d1550 0x7fafb81d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafb813fc90 0x7fafb8140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81d0e00 con 0x7fafb813fc90 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81d0350 con 0x7fafa40039f0 2024-09-16T06:47:49.876 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb8140650 con 0x7fafb81d1550 2024-09-16T06:47:49.877 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafb81d1550 0x7fafb81d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:49.877 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbd6e0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafb813fc90 0x7fafb8140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:49.877 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb7fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafb81d1550 0x7fafb81d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:47344/0 (socket says 172.21.15.96:47344) 2024-09-16T06:47:49.877 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb7fff640 1 -- 172.21.15.96:0/3586378712 learned_addr learned my addr 172.21.15.96:0/3586378712 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:49.877 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbcedf640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40039f0 0x7fafb80af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbd6e0640 1 -- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafb81d1550 msgr2=0x7fafb81d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbd6e0640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafb81d1550 0x7fafb81d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbd6e0640 1 -- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40039f0 msgr2=0x7fafb80af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbd6e0640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40039f0 0x7fafb80af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbd6e0640 1 -- 172.21.15.96:0/3586378712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb81d0b20 con 0x7fafb813fc90 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb7fff640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafb81d1550 0x7fafb81d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbd6e0640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafb813fc90 0x7fafb8140110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fafb806d4d0 tx=0x7fafb0010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000e8a0 con 0x7fafb813fc90 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000ea00 con 0x7fafb813fc90 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000ed70 con 0x7fafb813fc90 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.866+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb81d1fc0 con 0x7fafb813fc90 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb80aea20 con 0x7fafb813fc90 2024-09-16T06:47:49.878 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb8146300 con 0x7fafb813fc90 2024-09-16T06:47:49.879 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 128890+0+0 (secure 0 0 0) 0x7fafb0020410 con 0x7fafb813fc90 2024-09-16T06:47:49.879 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafb57fa640 20 mgrc handle_mgr_map mgrmap(e 7) v1 2024-09-16T06:47:49.879 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:49.870+0000 7feba1c32180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafb57fa640 4 mgrc handle_mgr_map Got map version 7 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafb57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafb57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafb57fa640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 0x7faf98099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafbcedf640 1 -- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 msgr2=0x7faf98099d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/468510839 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4479+0+0 (secure 0 0 0) 0x7fafb00bf6e0 con 0x7fafb813fc90 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.870+0000 7fafbcedf640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 0x7faf98099d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:47:49.880 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:49.874+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafb008cd80 con 0x7fafb813fc90 2024-09-16T06:47:49.882 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:49.880+0000 7f06be915180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:47:49.886 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:49.884+0000 7faf4d615180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:47:49.957 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:49.956+0000 7f06be915180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:47:49.961 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:49.960+0000 7faf4d615180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:47:49.965 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:49.962+0000 7feba1c32180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:47:50.011 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.012+0000 7faf4d615180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:47:50.015 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.016+0000 7f06be915180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:47:50.017 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.014+0000 7feba1c32180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:47:50.041 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.038+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fafb8145f70 con 0x7fafb813fc90 2024-09-16T06:47:50.042 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.038+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v22) v1 ==== 59+0+37 (secure 0 0 0) 0x7fafb008ecb0 con 0x7fafb813fc90 2024-09-16T06:47:50.077 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.074+0000 7fafbcedf640 1 -- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 msgr2=0x7faf98099d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/468510839 2024-09-16T06:47:50.077 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.074+0000 7fafbcedf640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 0x7faf98099d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:47:50.084 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.084+0000 7faf4d615180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:47:50.091 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.086+0000 7feba1c32180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:47:50.129 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fafb81d0840 con 0x7fafb813fc90 2024-09-16T06:47:50.129 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafb57fa640 1 -- 172.21.15.96:0/3586378712 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v22) v1 ==== 59+0+37 (secure 0 0 0) 0x7fafb0090430 con 0x7fafb813fc90 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 10 mgrc shutdown 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 msgr2=0x7faf98099d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 0x7faf98099d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafb813fc90 msgr2=0x7fafb8140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafb813fc90 0x7fafb8140110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fafb806d4d0 tx=0x7fafb0010c20 comp rx=0 tx=0).stop 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 shutdown_connections 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:6824/468510839,v1:172.21.15.134:6825/468510839] conn(0x7faf980978c0 0x7faf98099d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:50.132 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafb813fc90 0x7fafb8140110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:50.133 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fafb81d1550 0x7fafb81d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:50.133 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 --2- 172.21.15.96:0/3586378712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafa40039f0 0x7fafb80af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:50.133 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 >> 172.21.15.96:0/3586378712 conn(0x7fafb806d540 msgr2=0x7fafb8146bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:50.133 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 shutdown_connections 2024-09-16T06:47:50.133 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:50.126+0000 7fafbf143640 1 -- 172.21.15.96:0/3586378712 wait complete. 2024-09-16T06:47:50.134 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.132+0000 7faf4d615180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:47:50.141 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.138+0000 7feba1c32180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:47:50.145 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.144+0000 7f06be915180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:47:50.146 INFO:tasks.workunit.client.0.smithi096.stderr:+ sleep 5 2024-09-16T06:47:50.209 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.208+0000 7f06be915180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:47:50.277 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.276+0000 7faf4d615180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:47:50.281 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.278+0000 7feba1c32180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:47:50.329 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.328+0000 7faf4d615180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:47:50.331 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.326+0000 7feba1c32180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:47:50.349 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.348+0000 7f06be915180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:47:50.401 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.400+0000 7f06be915180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:47:50.546 INFO:tasks.ceph.mgr.x.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:47:50.546 INFO:tasks.ceph.mgr.x.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:47:50.546 INFO:tasks.ceph.mgr.x.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:47:50.548 INFO:tasks.ceph.mgr.z.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:47:50.548 INFO:tasks.ceph.mgr.z.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:47:50.548 INFO:tasks.ceph.mgr.z.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:47:50.553 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.550+0000 7feba1c32180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:47:50.555 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.556+0000 7faf4d615180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:47:50.661 INFO:tasks.ceph.mgr.y.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:47:50.661 INFO:tasks.ceph.mgr.y.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:47:50.661 INFO:tasks.ceph.mgr.y.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:47:50.668 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.668+0000 7f06be915180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:47:50.683 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.678+0000 7feba1c32180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:50.731 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.732+0000 7faf4d615180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:50.792 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.786+0000 7feba1c32180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:50.803 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.804+0000 7f06be915180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:50.845 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.844+0000 7faf4d615180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:50.854 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.850+0000 7feba1c32180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:47:50.952 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:50.908+0000 7faf4d615180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:47:50.952 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.916+0000 7f06be915180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:50.978 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:50.976+0000 7f06be915180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:47:50.983 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:50.978+0000 7feba1c32180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:51.042 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:51.040+0000 7faf4d615180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:51.111 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:51.112+0000 7f06be915180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:51.451 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:51.446+0000 7feba1c32180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:47:51.522 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:51.518+0000 7feba1c32180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:47:51.528 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:51.528+0000 7faf4d615180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:47:51.593 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:51.592+0000 7f06be915180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:47:51.602 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:51.600+0000 7faf4d615180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:47:51.662 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:51.658+0000 7feba1c32180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:47:51.667 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:51.668+0000 7f06be915180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:47:51.733 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:51.730+0000 7feba1c32180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:47:51.746 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:51.744+0000 7faf4d615180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:47:51.812 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:51.812+0000 7f06be915180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:47:51.821 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:51.820+0000 7faf4d615180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:47:51.885 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:51.884+0000 7f06be915180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:47:52.007 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:52.002+0000 7feba1c32180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:47:52.060 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:52.058+0000 7feba1c32180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:47:52.103 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.104+0000 7faf4d615180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:47:52.161 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.160+0000 7faf4d615180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:47:52.168 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:52.168+0000 7f06be915180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:47:52.230 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:52.228+0000 7f06be915180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed8b92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed8b92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed8b92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed8b92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed8b92640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed5b8c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed5b8c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed5b8c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed5b8c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:52.270 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:52.268+0000 7faed5b8c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:55.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd pool ls 2024-09-16T06:47:55.148 INFO:tasks.workunit.client.0.smithi096.stderr:+ grep ^by-host- 2024-09-16T06:47:55.284 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.278+0000 7faf57a31640 1 Processor -- start 2024-09-16T06:47:55.284 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.278+0000 7faf57a31640 1 -- start start 2024-09-16T06:47:55.285 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf57a31640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf500a2490 0x7faf500a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.285 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf57a31640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf500a2e80 con 0x7faf5006abd0 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf57a31640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf500a3b10 con 0x7faf500a1d80 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf57a31640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf500a3dd0 con 0x7faf500a2490 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf54fcc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7faf5006abd0 0x7faf501482f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:44190/0 (socket says 172.21.15.96:44190) 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf54fcc640 1 -- 172.21.15.96:0/1058905012 learned_addr learned my addr 172.21.15.96:0/1058905012 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf557cd640 1 --2- 172.21.15.96:0/1058905012 >> v2:172.21.15.134:3300/0 conn(0x7faf500a2490 0x7faf500a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf47fff640 1 -- 172.21.15.96:0/1058905012 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072424119 0 0) 0x7faf500a2e80 con 0x7faf5006abd0 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf47fff640 1 -- 172.21.15.96:0/1058905012 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c003530 con 0x7faf5006abd0 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf557cd640 1 -- 172.21.15.96:0/1058905012 >> v1:172.21.15.134:6789/0 conn(0x7faf500a1d80 legacy=0x7faf501522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf557cd640 1 -- 172.21.15.96:0/1058905012 >> v1:172.21.15.96:6789/0 conn(0x7faf5006abd0 legacy=0x7faf501482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.286 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf557cd640 1 -- 172.21.15.96:0/1058905012 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf500a1270 con 0x7faf500a2490 2024-09-16T06:47:55.288 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.282+0000 7faf557cd640 1 --2- 172.21.15.96:0/1058905012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 0x7faf500a56c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0097c0 tx=0x7faf4c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e351366ec45802bf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:55.288 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf47fff640 1 -- 172.21.15.96:0/1058905012 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0ac410 con 0x7faf500a2490 2024-09-16T06:47:55.288 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf47fff640 1 -- 172.21.15.96:0/1058905012 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c0ac570 con 0x7faf500a2490 2024-09-16T06:47:55.289 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- 172.21.15.96:0/1058905012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 msgr2=0x7faf500a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.290 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 --2- 172.21.15.96:0/1058905012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 0x7faf500a56c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0097c0 tx=0x7faf4c01c390 comp rx=0 tx=0).stop 2024-09-16T06:47:55.290 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- 172.21.15.96:0/1058905012 shutdown_connections 2024-09-16T06:47:55.290 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 --2- 172.21.15.96:0/1058905012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 0x7faf500a56c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.290 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- 172.21.15.96:0/1058905012 >> 172.21.15.96:0/1058905012 conn(0x7faf5006d540 msgr2=0x7faf5006d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:55.290 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- 172.21.15.96:0/1058905012 shutdown_connections 2024-09-16T06:47:55.290 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- 172.21.15.96:0/1058905012 wait complete. 2024-09-16T06:47:55.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 Processor -- start 2024-09-16T06:47:55.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- start start 2024-09-16T06:47:55.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5006abd0 0x7faf50070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf500a1d80 0x7faf500b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 0x7faf5006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500b63b0 con 0x7faf5006abd0 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5006faf0 con 0x7faf500a2490 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf57a31640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5006fd60 con 0x7faf500a1d80 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf54fcc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf500a1d80 0x7faf500b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf54fcc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf500a1d80 0x7faf500b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34436/0 (socket says 172.21.15.96:34436) 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf54fcc640 1 -- 172.21.15.96:0/4269560248 learned_addr learned my addr 172.21.15.96:0/4269560248 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:55.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.286+0000 7faf557cd640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5006abd0 0x7faf50070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.294 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf54fcc640 1 -- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 msgr2=0x7faf5006e490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:55.294 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf54fcc640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 0x7faf5006e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.295 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf54fcc640 1 -- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5006abd0 msgr2=0x7faf50070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.295 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf54fcc640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5006abd0 0x7faf50070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.295 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf54fcc640 1 -- 172.21.15.96:0/4269560248 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c009420 con 0x7faf500a1d80 2024-09-16T06:47:55.295 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf54fcc640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf500a1d80 0x7faf500b4830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf4800cbb0 tx=0x7faf4800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:55.295 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800ad40 con 0x7faf500a1d80 2024-09-16T06:47:55.296 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48012400 con 0x7faf500a1d80 2024-09-16T06:47:55.297 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf500b6900 con 0x7faf500a1d80 2024-09-16T06:47:55.297 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800aea0 con 0x7faf500a1d80 2024-09-16T06:47:55.297 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf500b53f0 con 0x7faf500a1d80 2024-09-16T06:47:55.297 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf500a56c0 con 0x7faf500a1d80 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 11) v1 ==== 128936+0+0 (secure 0 0 0) 0x7faf48007070 con 0x7faf500a1d80 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.290+0000 7faf45ffb640 20 mgrc handle_mgr_map mgrmap(e 11) v1 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.294+0000 7faf45ffb640 4 mgrc handle_mgr_map Got map version 11 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.294+0000 7faf45ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.294+0000 7faf45ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.294+0000 7faf45ffb640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7faf34097920 0x7faf34099de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.294+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5166+0+0 (secure 0 0 0) 0x7faf480c03c0 con 0x7faf500a1d80 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.294+0000 7faf557cd640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7faf34097920 0x7faf34099de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.298 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.294+0000 7faf557cd640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7faf34097920 0x7faf34099de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0ae000 tx=0x7faf4c0a6040 comp rx=0 tx=0).ready entity=mgr.4387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:55.300 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.298+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf4808d900 con 0x7faf500a1d80 2024-09-16T06:47:55.459 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.454+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7faf5006a9b0 con 0x7faf500a1d80 2024-09-16T06:47:55.459 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.454+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v26) v1 ==== 59+0+55 (secure 0 0 0) 0x7faf48017050 con 0x7faf500a1d80 2024-09-16T06:47:55.551 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.546+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7faf5006f760 con 0x7faf500a1d80 2024-09-16T06:47:55.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.546+0000 7faf45ffb640 1 -- 172.21.15.96:0/4269560248 <== mon.2 v2:172.21.15.96:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v26) v1 ==== 59+0+55 (secure 0 0 0) 0x7faf48017020 con 0x7faf500a1d80 2024-09-16T06:47:55.554 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 10 mgrc shutdown 2024-09-16T06:47:55.554 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7faf34097920 msgr2=0x7faf34099de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.554 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7faf34097920 0x7faf34099de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0ae000 tx=0x7faf4c0a6040 comp rx=0 tx=0).stop 2024-09-16T06:47:55.554 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf500a1d80 msgr2=0x7faf500b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.554 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf500a1d80 0x7faf500b4830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf4800cbb0 tx=0x7faf4800a430 comp rx=0 tx=0).stop 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 shutdown_connections 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7faf34097920 0x7faf34099de0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf500a2490 0x7faf5006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf500a1d80 0x7faf500b4830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 --2- 172.21.15.96:0/4269560248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf5006abd0 0x7faf50070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 >> 172.21.15.96:0/4269560248 conn(0x7faf5006d540 msgr2=0x7faf5006d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 shutdown_connections 2024-09-16T06:47:55.555 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.550+0000 7faf57a31640 1 -- 172.21.15.96:0/4269560248 wait complete. 2024-09-16T06:47:55.569 INFO:tasks.workunit.client.0.smithi096.stdout:by-host-smithi096 2024-09-16T06:47:55.569 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph mgr module disable localpool 2024-09-16T06:47:55.686 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f6801b48640 1 Processor -- start 2024-09-16T06:47:55.686 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f6801b48640 1 -- start start 2024-09-16T06:47:55.687 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f6801b48640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f67fc06d310 0x7f67fc144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f6801b48640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f67fc145420 0x7f67fc14bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f6801b48640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc073b60 con 0x7f67fc073780 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f6801b48640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc144c20 con 0x7f67fc145420 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f6801b48640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc06d740 con 0x7f67fc06d310 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67fbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f67fc145420 0x7f67fc14bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67fbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f67fc145420 0x7f67fc14bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40700/0 (socket says 172.21.15.96:40700) 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67fbfff640 1 -- 172.21.15.96:0/4180289823 learned_addr learned my addr 172.21.15.96:0/4180289823 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67faffd640 1 --2- 172.21.15.96:0/4180289823 >> v2:172.21.15.134:3300/0 conn(0x7f67fc06d310 0x7f67fc144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67fbfff640 1 -- 172.21.15.96:0/4180289823 >> v2:172.21.15.134:3300/0 conn(0x7f67fc06d310 msgr2=0x7f67fc144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67fbfff640 1 --2- 172.21.15.96:0/4180289823 >> v2:172.21.15.134:3300/0 conn(0x7f67fc06d310 0x7f67fc144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67fbfff640 1 -- 172.21.15.96:0/4180289823 >> v1:172.21.15.134:6789/0 conn(0x7f67fc073780 legacy=0x7f67fc06e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:55.688 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.682+0000 7f67fbfff640 1 -- 172.21.15.96:0/4180289823 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc0a4280 con 0x7f67fc145420 2024-09-16T06:47:55.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f67fbfff640 1 --2- 172.21.15.96:0/4180289823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc14bb70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67fc137870 tx=0x7f67f401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d086f3fdd5e0e7cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:55.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f67fa7fc640 1 -- 172.21.15.96:0/4180289823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40a56d0 con 0x7f67fc145420 2024-09-16T06:47:55.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f67fa7fc640 1 -- 172.21.15.96:0/4180289823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f40a5830 con 0x7f67fc145420 2024-09-16T06:47:55.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f67fa7fc640 1 -- 172.21.15.96:0/4180289823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40a5bc0 con 0x7f67fc145420 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 -- 172.21.15.96:0/4180289823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 msgr2=0x7f67fc14bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 --2- 172.21.15.96:0/4180289823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc14bb70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67fc137870 tx=0x7f67f401c900 comp rx=0 tx=0).stop 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 -- 172.21.15.96:0/4180289823 shutdown_connections 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 --2- 172.21.15.96:0/4180289823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc14bb70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 --2- 172.21.15.96:0/4180289823 >> v2:172.21.15.134:3300/0 conn(0x7f67fc06d310 0x7f67fc144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 -- 172.21.15.96:0/4180289823 >> 172.21.15.96:0/4180289823 conn(0x7f67fc069f80 msgr2=0x7f67fc072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 -- 172.21.15.96:0/4180289823 shutdown_connections 2024-09-16T06:47:55.691 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 -- 172.21.15.96:0/4180289823 wait complete. 2024-09-16T06:47:55.692 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 Processor -- start 2024-09-16T06:47:55.692 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.686+0000 7f6801b48640 1 -- start start 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67fc06d310 0x7f67fc0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67fc073780 0x7f67fc0b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc070df0 con 0x7f67fc145420 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0710b0 con 0x7f67fc073780 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0b5270 con 0x7f67fc06d310 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67fc06d310 0x7f67fc0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.694 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40714/0 (socket says 172.21.15.96:40714) 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 -- 172.21.15.96:0/1093648055 learned_addr learned my addr 172.21.15.96:0/1093648055 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67faffd640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67fc073780 0x7f67fc0b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67fc06d310 msgr2=0x7f67fc0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67fc06d310 0x7f67fc0b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67fc073780 msgr2=0x7f67fc0b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67fc073780 0x7f67fc0b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 -- 172.21.15.96:0/1093648055 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4009b30 con 0x7f67fc145420 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67faffd640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67fc073780 0x7f67fc0b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67fbfff640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc0b1ee0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67f40af040 tx=0x7f67f40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40b8670 con 0x7f67fc145420 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f40b87d0 con 0x7f67fc145420 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc143d90 con 0x7f67fc145420 2024-09-16T06:47:55.695 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40b8b80 con 0x7f67fc145420 2024-09-16T06:47:55.696 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc0b3a30 con 0x7f67fc145420 2024-09-16T06:47:55.696 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc0b5cf0 con 0x7f67fc145420 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 128936+0+0 (secure 0 0 0) 0x7f67f40b8ce0 con 0x7f67fc145420 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 20 mgrc handle_mgr_map mgrmap(e 11) v1 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 4 mgrc handle_mgr_map Got map version 11 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.690+0000 7f67f3fff640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67dc099de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.694+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5166+0+0 (secure 0 0 0) 0x7f67f415b820 con 0x7f67fc145420 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.694+0000 7f67fb7fe640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67dc099de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:55.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.694+0000 7f67fb7fe640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67dc099de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67e4007fd0 tx=0x7f67e4007e40 comp rx=0 tx=0).ready entity=mgr.4387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:55.700 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.694+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f67f4128c20 con 0x7f67fc145420 2024-09-16T06:47:55.899 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:55.894+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "localpool"} v 0) v1 -- 0x7f67fc137b10 con 0x7f67fc145420 2024-09-16T06:47:56.271 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.266+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 12) v1 ==== 128979+0+0 (secure 0 0 0) 0x7f67f4128ff0 con 0x7f67fc145420 2024-09-16T06:47:56.271 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.266+0000 7f67f3fff640 20 mgrc handle_mgr_map mgrmap(e 12) v1 2024-09-16T06:47:56.272 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.266+0000 7f67f3fff640 4 mgrc handle_mgr_map Got map version 12 2024-09-16T06:47:56.272 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.266+0000 7f67f3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:56.272 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.270+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "localpool"}]=0 v12) v1 ==== 89+0+0 (secure 0 0 0) 0x7f67f415d4d0 con 0x7f67fc145420 2024-09-16T06:47:56.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67fb7fe640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 msgr2=0x7f67dc099de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T06:47:56.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67fb7fe640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 msgr2=0x7f67dc099de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T06:47:56.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67fb7fe640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67dc099de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67e4007fd0 tx=0x7f67e4007e40 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T06:47:56.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67fb7fe640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67dc099de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67e4007fd0 tx=0x7f67e4007e40 comp rx=0 tx=0).stop 2024-09-16T06:47:56.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67f3fff640 4 mgrc ms_handle_reset ms_handle_reset con 0x7f67dc097920 2024-09-16T06:47:56.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67f3fff640 4 mgrc reconnect Terminating session with v2:172.21.15.134:6824/200992303 2024-09-16T06:47:56.293 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 msgr2=0x7f67dc099de0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T06:47:56.294 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67f3fff640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67dc099de0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:56.294 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.290+0000 7f67f3fff640 4 mgrc reconnect waiting to retry connect until 715.291900s 2024-09-16T06:47:56.396 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:56.395+0000 7f90f3b19180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:47:56.400 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:56.399+0000 7ff6fe2a2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:47:56.410 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:56.406+0000 7f27a1052180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T06:47:56.438 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.434+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "localpool"} v 0) v1 -- 0x7f67d4005070 con 0x7f67fc145420 2024-09-16T06:47:56.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.694+0000 7f67f27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:56.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.694+0000 7f67f27fc640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67fc0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:56.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.694+0000 7f67fb7fe640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 msgr2=0x7f67fc0b2420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:56.697 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.694+0000 7f67fb7fe640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67fc0b2420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:47:56.778 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:56.775+0000 7f90f3b19180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:47:56.781 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:56.779+0000 7ff6fe2a2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:47:56.782 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:56.778+0000 7f27a1052180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T06:47:56.900 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.898+0000 7f67fb7fe640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 msgr2=0x7f67fc0b2420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:56.901 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:56.898+0000 7f67fb7fe640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67fc0b2420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:47:56.909 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:56.907+0000 7f90f3b19180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:47:56.911 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:56.906+0000 7f27a1052180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:47:56.914 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:56.911+0000 7ff6fe2a2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T06:47:57.279 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.274+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 9 ==== mgrmap(e 13) v1 ==== 128979+0+0 (secure 0 0 0) 0x7f67f41404a0 con 0x7f67fc145420 2024-09-16T06:47:57.279 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.274+0000 7f67f3fff640 20 mgrc handle_mgr_map mgrmap(e 13) v1 2024-09-16T06:47:57.281 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.278+0000 7f67f3fff640 4 mgrc handle_mgr_map Got map version 13 2024-09-16T06:47:57.281 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.278+0000 7f67f3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:57.287 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.282+0000 7f67f3fff640 1 -- 172.21.15.96:0/1093648055 <== mon.0 v2:172.21.15.96:3300/0 10 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "localpool"}]=0 module 'localpool' is already disabled v13) v1 ==== 127+0+0 (secure 0 0 0) 0x7f67f41293b0 con 0x7f67fc145420 2024-09-16T06:47:57.288 INFO:tasks.workunit.client.0.smithi096.stderr:module 'localpool' is already disabled 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 10 mgrc shutdown 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 msgr2=0x7f67fc0b2420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67fc0b2420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 msgr2=0x7f67fc0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc0b1ee0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67f40af040 tx=0x7f67f40196a0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 shutdown_connections 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f67dc097920 0x7f67fc0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.291 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67fc145420 0x7f67fc0b1ee0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67fc073780 0x7f67fc0b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 --2- 172.21.15.96:0/1093648055 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67fc06d310 0x7f67fc0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 >> 172.21.15.96:0/1093648055 conn(0x7f67fc069f80 msgr2=0x7f67fc13e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:57.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 shutdown_connections 2024-09-16T06:47:57.292 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.286+0000 7f6801b48640 1 -- 172.21.15.96:0/1093648055 wait complete. 2024-09-16T06:47:57.305 INFO:tasks.workunit.client.0.smithi096.stderr:+ + grep ^by-host- 2024-09-16T06:47:57.305 INFO:tasks.workunit.client.0.smithi096.stderr:ceph osd pool ls 2024-09-16T06:47:57.333 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.330+0000 7f27a1052180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:57.334 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.331+0000 7f90f3b19180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:57.339 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.339+0000 7ff6fe2a2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:57.386 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.382+0000 7f27a1052180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:47:57.387 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.383+0000 7f90f3b19180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:47:57.391 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.391+0000 7ff6fe2a2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T06:47:57.418 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59aa1bc640 1 Processor -- start 2024-09-16T06:47:57.418 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59aa1bc640 1 -- start start 2024-09-16T06:47:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59aa1bc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a406e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59aa1bc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f59a40a39f0 0x7f59a4140730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59aa1bc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a40a5d60 con 0x7f59a406ac00 2024-09-16T06:47:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59aa1bc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a40a3680 con 0x7f59a40a39f0 2024-09-16T06:47:57.419 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59aa1bc640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a406a770 con 0x7f59a40a5980 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a406e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f59a40a39f0 0x7f59a4140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a37fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a406e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34466/0 (socket says 172.21.15.96:34466) 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f59a40a39f0 0x7f59a4140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40750/0 (socket says 172.21.15.96:40750) 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a37fe640 1 -- 172.21.15.96:0/2502597430 learned_addr learned my addr 172.21.15.96:0/2502597430 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a37fe640 1 -- 172.21.15.96:0/2502597430 >> v2:172.21.15.96:3300/0 conn(0x7f59a40a39f0 msgr2=0x7f59a4140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a37fe640 1 --2- 172.21.15.96:0/2502597430 >> v2:172.21.15.96:3300/0 conn(0x7f59a40a39f0 0x7f59a4140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a37fe640 1 -- 172.21.15.96:0/2502597430 >> v1:172.21.15.96:6789/0 conn(0x7f59a406ac00 legacy=0x7f59a40b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a37fe640 1 -- 172.21.15.96:0/2502597430 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40a4cc0 con 0x7f59a40a5980 2024-09-16T06:47:57.420 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.414+0000 7f59a2ffd640 1 --2- 172.21.15.96:0/2502597430 >> v2:172.21.15.96:3300/0 conn(0x7f59a40a39f0 0x7f59a4140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:47:57.421 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 --2- 172.21.15.96:0/2502597430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a406e570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f599c009e50 tx=0x7f599c01c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212f35da4034c45a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:57.421 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a27fc640 1 -- 172.21.15.96:0/2502597430 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0a5730 con 0x7f59a40a5980 2024-09-16T06:47:57.421 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a27fc640 1 -- 172.21.15.96:0/2502597430 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c0a5890 con 0x7f59a40a5980 2024-09-16T06:47:57.421 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a27fc640 1 -- 172.21.15.96:0/2502597430 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0a5c20 con 0x7f59a40a5980 2024-09-16T06:47:57.422 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- 172.21.15.96:0/2502597430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 msgr2=0x7f59a406e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.422 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/2502597430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a406e570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f599c009e50 tx=0x7f599c01c980 comp rx=0 tx=0).stop 2024-09-16T06:47:57.422 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- 172.21.15.96:0/2502597430 shutdown_connections 2024-09-16T06:47:57.423 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/2502597430 >> v2:172.21.15.96:3300/0 conn(0x7f59a40a39f0 0x7f59a4140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.423 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/2502597430 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a406e570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.423 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- 172.21.15.96:0/2502597430 >> 172.21.15.96:0/2502597430 conn(0x7f59a406d540 msgr2=0x7f59a406d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:57.423 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- 172.21.15.96:0/2502597430 shutdown_connections 2024-09-16T06:47:57.423 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- 172.21.15.96:0/2502597430 wait complete. 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 Processor -- start 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- start start 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59a406ac00 0x7f59a40a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a40a39f0 0x7f59a40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a4138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40a8200 con 0x7f59a406ac00 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a40a88e0 con 0x7f59a40a39f0 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59aa1bc640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a413f8e0 con 0x7f59a40a5980 2024-09-16T06:47:57.425 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59a406ac00 0x7f59a40a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a3fff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a4138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59a406ac00 0x7f59a40a79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40758/0 (socket says 172.21.15.96:40758) 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 -- 172.21.15.96:0/1902627951 learned_addr learned my addr 172.21.15.96:0/1902627951 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 -- 172.21.15.96:0/1902627951 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 msgr2=0x7f59a4138e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a4138e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 -- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a40a39f0 msgr2=0x7f59a40b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a40a39f0 0x7f59a40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.418+0000 7f59a37fe640 1 -- 172.21.15.96:0/1902627951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c009420 con 0x7f59a406ac00 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f59a37fe640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59a406ac00 0x7f59a40a79b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f599c01b030 tx=0x7f599c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0b8880 con 0x7f59a406ac00 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c009b30 con 0x7f59a406ac00 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a40a6f50 con 0x7f59a406ac00 2024-09-16T06:47:57.426 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c009510 con 0x7f59a406ac00 2024-09-16T06:47:57.427 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0b8be0 con 0x7f59a406ac00 2024-09-16T06:47:57.427 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a4140730 con 0x7f59a406ac00 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 128979+0+0 (secure 0 0 0) 0x7f599c0b8d40 con 0x7f59a406ac00 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 20 mgrc handle_mgr_map mgrmap(e 13) v1 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 4 mgrc handle_mgr_map Got map version 13 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 0x7f5984099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f59a2ffd640 1 -- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 msgr2=0x7f5984099dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5239+0+0 (secure 0 0 0) 0x7f599c15b660 con 0x7f59a406ac00 2024-09-16T06:47:57.428 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.422+0000 7f59a2ffd640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 0x7f5984099dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:47:57.432 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.426+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f599c128bc0 con 0x7f59a406ac00 2024-09-16T06:47:57.435 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.435+0000 7f90f3b19180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:47:57.437 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.434+0000 7f27a1052180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:47:57.440 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.439+0000 7ff6fe2a2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T06:47:57.511 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.511+0000 7f90f3b19180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:47:57.513 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.510+0000 7f27a1052180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:47:57.516 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.515+0000 7ff6fe2a2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T06:47:57.561 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.559+0000 7f90f3b19180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:47:57.562 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.558+0000 7f27a1052180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:47:57.565 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.563+0000 7ff6fe2a2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T06:47:57.589 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.586+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f59a4071a20 con 0x7f59a406ac00 2024-09-16T06:47:57.590 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.586+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) v1 ==== 59+0+55 (secure 0 0 0) 0x7f599c12c1e0 con 0x7f59a406ac00 2024-09-16T06:47:57.628 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.626+0000 7f59a2ffd640 1 -- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 msgr2=0x7f5984099dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:57.629 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.626+0000 7f59a2ffd640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 0x7f5984099dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:47:57.634 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.631+0000 7f90f3b19180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:47:57.635 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.630+0000 7f27a1052180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:47:57.639 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.639+0000 7ff6fe2a2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T06:47:57.684 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.683+0000 7f90f3b19180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:47:57.685 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f59a40a8600 con 0x7f59a406ac00 2024-09-16T06:47:57.685 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f27a1052180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:47:57.686 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f599bfff640 1 -- 172.21.15.96:0/1902627951 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v28) v1 ==== 59+0+55 (secure 0 0 0) 0x7f599c12c3c0 con 0x7f59a406ac00 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 10 mgrc shutdown 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 msgr2=0x7f5984099dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 0x7f5984099dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59a406ac00 msgr2=0x7f59a40a79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59a406ac00 0x7f59a40a79b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f599c01b030 tx=0x7f599c019720 comp rx=0 tx=0).stop 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 shutdown_connections 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5984097910 0x7f5984099dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f59a40a5980 0x7f59a4138e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.689 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59a40a39f0 0x7f59a40b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 --2- 172.21.15.96:0/1902627951 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59a406ac00 0x7f59a40a79b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 >> 172.21.15.96:0/1902627951 conn(0x7f59a406d540 msgr2=0x7f59a406b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:57.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 shutdown_connections 2024-09-16T06:47:57.690 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.682+0000 7f59aa1bc640 1 -- 172.21.15.96:0/1902627951 wait complete. 2024-09-16T06:47:57.690 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.687+0000 7ff6fe2a2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T06:47:57.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph osd pool rm by-host-smithi096 by-host-smithi096 --yes-i-really-really-mean-it 2024-09-16T06:47:57.823 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a8c3c640 1 Processor -- start 2024-09-16T06:47:57.823 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a8c3c640 1 -- start start 2024-09-16T06:47:57.824 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a8c3c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f21a4066310 0x7f21a41451e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.824 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a8c3c640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f21a4070ce0 0x7f21a414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.824 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a8c3c640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40666f0 con 0x7f21a40a3d00 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a8c3c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a40a4150 con 0x7f21a4066310 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a8c3c640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a4141240 con 0x7f21a4070ce0 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f21a4066310 0x7f21a41451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f21a4066310 0x7f21a41451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40762/0 (socket says 172.21.15.96:40762) 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a259c640 1 -- 172.21.15.96:0/1707108762 learned_addr learned my addr 172.21.15.96:0/1707108762 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a2d9d640 1 --2- 172.21.15.96:0/1707108762 >> v2:172.21.15.134:3300/0 conn(0x7f21a4070ce0 0x7f21a414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a259c640 1 -- 172.21.15.96:0/1707108762 >> v2:172.21.15.134:3300/0 conn(0x7f21a4070ce0 msgr2=0x7f21a414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a259c640 1 --2- 172.21.15.96:0/1707108762 >> v2:172.21.15.134:3300/0 conn(0x7f21a4070ce0 0x7f21a414bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a259c640 1 -- 172.21.15.96:0/1707108762 >> v1:172.21.15.134:6789/0 conn(0x7f21a40a3d00 legacy=0x7f21a409fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a259c640 1 -- 172.21.15.96:0/1707108762 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a41449d0 con 0x7f21a4066310 2024-09-16T06:47:57.825 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.818+0000 7f21a2d9d640 1 --2- 172.21.15.96:0/1707108762 >> v2:172.21.15.134:3300/0 conn(0x7f21a4070ce0 0x7f21a414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:47:57.826 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.823+0000 7f90f3b19180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:47:57.826 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a259c640 1 --2- 172.21.15.96:0/1707108762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4066310 0x7f21a41451e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21a40a5b10 tx=0x7f219c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd9724b52580a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:57.827 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a159a640 1 -- 172.21.15.96:0/1707108762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c0a57e0 con 0x7f21a4066310 2024-09-16T06:47:57.827 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a159a640 1 -- 172.21.15.96:0/1707108762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c0a5940 con 0x7f21a4066310 2024-09-16T06:47:57.827 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a159a640 1 -- 172.21.15.96:0/1707108762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c0a5cd0 con 0x7f21a4066310 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1707108762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4066310 msgr2=0x7f21a41451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1707108762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4066310 0x7f21a41451e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21a40a5b10 tx=0x7f219c01c990 comp rx=0 tx=0).stop 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1707108762 shutdown_connections 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1707108762 >> v2:172.21.15.134:3300/0 conn(0x7f21a4070ce0 0x7f21a414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1707108762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4066310 0x7f21a41451e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1707108762 >> 172.21.15.96:0/1707108762 conn(0x7f21a40a4ac0 msgr2=0x7f21a40a4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1707108762 shutdown_connections 2024-09-16T06:47:57.828 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.822+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1707108762 wait complete. 2024-09-16T06:47:57.830 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 Processor -- start 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 -- start start 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a4066310 0x7f21a4143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4070ce0 0x7f21a4140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a40a3d00 0x7f21a4137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4138a90 con 0x7f21a4070ce0 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4138d50 con 0x7f21a4066310 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4139620 con 0x7f21a40a3d00 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a1d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4070ce0 0x7f21a4140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a2d9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a40a3d00 0x7f21a4137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a1d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4070ce0 0x7f21a4140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40768/0 (socket says 172.21.15.96:40768) 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a1d9b640 1 -- 172.21.15.96:0/1811911506 learned_addr learned my addr 172.21.15.96:0/1811911506 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:57.831 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a259c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a4066310 0x7f21a4143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a2d9d640 1 -- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a4066310 msgr2=0x7f21a4143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a2d9d640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a4066310 0x7f21a4143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a2d9d640 1 -- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4070ce0 msgr2=0x7f21a4140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a2d9d640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4070ce0 0x7f21a4140250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a2d9d640 1 -- 172.21.15.96:0/1811911506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c009b30 con 0x7f21a40a3d00 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a1d9b640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4070ce0 0x7f21a4140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a259c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a4066310 0x7f21a4143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a2d9d640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a40a3d00 0x7f21a4137560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f219400c5e0 tx=0x7f219400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194011800 con 0x7f21a40a3d00 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2194011960 con 0x7f21a40a3d00 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a406daa0 con 0x7f21a40a3d00 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194011d10 con 0x7f21a40a3d00 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a413a2e0 con 0x7f21a40a3d00 2024-09-16T06:47:57.832 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.826+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a413a5c0 con 0x7f21a40a3d00 2024-09-16T06:47:57.833 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.831+0000 7ff6fe2a2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:47:57.833 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f27a1052180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 13) v1 ==== 128979+0+0 (secure 0 0 0) 0x7f2194024480 con 0x7f21a40a3d00 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f2192ffd640 20 mgrc handle_mgr_map mgrmap(e 13) v1 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f2192ffd640 4 mgrc handle_mgr_map Got map version 13 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f2192ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f2192ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f2192ffd640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 0x7f2184099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f21a259c640 1 -- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 msgr2=0x7f2184099e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:57.834 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5239+0+0 (secure 0 0 0) 0x7f21940c0630 con 0x7f21a40a3d00 2024-09-16T06:47:57.835 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.830+0000 7f21a259c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 0x7f2184099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:47:57.836 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.834+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f219408d7b0 con 0x7f21a40a3d00 2024-09-16T06:47:57.876 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:57.875+0000 7f90f3b19180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:47:57.882 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:57.879+0000 7ff6fe2a2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:47:57.885 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:57.882+0000 7f27a1052180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T06:47:57.994 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:57.990+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "by-host-smithi096", "pool2": "by-host-smithi096", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21a413a5c0 con 0x7f21a40a3d00 2024-09-16T06:47:58.036 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.034+0000 7f21a259c640 1 -- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 msgr2=0x7f2184099e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:58.036 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.034+0000 7f21a259c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 0x7f2184099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:47:58.098 INFO:tasks.ceph.mgr.z.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:47:58.098 INFO:tasks.ceph.mgr.z.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:47:58.098 INFO:tasks.ceph.mgr.z.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:47:58.104 INFO:tasks.ceph.mgr.x.smithi096.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:47:58.104 INFO:tasks.ceph.mgr.x.smithi096.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:47:58.104 INFO:tasks.ceph.mgr.x.smithi096.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:47:58.105 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:58.103+0000 7f90f3b19180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:47:58.108 INFO:tasks.ceph.mgr.y.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T06:47:58.108 INFO:tasks.ceph.mgr.y.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T06:47:58.108 INFO:tasks.ceph.mgr.y.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-16T06:47:58.111 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:58.106+0000 7f27a1052180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:47:58.115 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:58.115+0000 7ff6fe2a2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T06:47:58.239 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:58.235+0000 7f90f3b19180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:58.242 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:58.238+0000 7f27a1052180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:58.250 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:58.247+0000 7ff6fe2a2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:58.279 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.274+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "by-host-smithi096", "pool2": "by-host-smithi096", "yes_i_really_really_mean_it": true}]=0 pool 'by-host-smithi096' removed v29) v1 ==== 187+0+0 (secure 0 0 0) 0x7f21a413a5c0 con 0x7f21a40a3d00 2024-09-16T06:47:58.352 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:58.351+0000 7f90f3b19180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:58.363 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:58.363+0000 7ff6fe2a2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:58.374 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:58.370+0000 7f27a1052180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T06:47:58.413 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.410+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "by-host-smithi096", "pool2": "by-host-smithi096", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21a413a5c0 con 0x7f21a40a3d00 2024-09-16T06:47:58.414 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:58.411+0000 7f90f3b19180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:47:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.410+0000 7f2192ffd640 1 -- 172.21.15.96:0/1811911506 <== mon.2 v2:172.21.15.96:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "by-host-smithi096", "pool2": "by-host-smithi096", "yes_i_really_really_mean_it": true}]=0 pool 'by-host-smithi096' does not exist v29) v1 ==== 194+0+0 (secure 0 0 0) 0x7f21a413a5c0 con 0x7f21a40a3d00 2024-09-16T06:47:58.414 INFO:tasks.workunit.client.0.smithi096.stderr:pool 'by-host-smithi096' does not exist 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.410+0000 7f21a8c3c640 10 mgrc shutdown 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 msgr2=0x7f2184099e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 0x7f2184099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a40a3d00 msgr2=0x7f21a4137560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a40a3d00 0x7f21a4137560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f219400c5e0 tx=0x7f219400c9e0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 shutdown_connections 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f2184097960 0x7f2184099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21a4070ce0 0x7f21a4140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f21a40a3d00 0x7f21a4137560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 --2- 172.21.15.96:0/1811911506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21a4066310 0x7f21a4143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.417 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 >> 172.21.15.96:0/1811911506 conn(0x7f21a40a4ac0 msgr2=0x7f21a406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:58.418 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 shutdown_connections 2024-09-16T06:47:58.418 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.414+0000 7f21a8c3c640 1 -- 172.21.15.96:0/1811911506 wait complete. 2024-09-16T06:47:58.425 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:58.423+0000 7ff6fe2a2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:47:58.431 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config rm mgr mgr/localpool/subtree 2024-09-16T06:47:58.438 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:58.434+0000 7f27a1052180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T06:47:58.540 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.534+0000 7f5ad8215640 1 Processor -- start 2024-09-16T06:47:58.540 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.534+0000 7f5ad8215640 1 -- start start 2024-09-16T06:47:58.541 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad00a6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.541 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5ad00a6dd0 0x7f5ad00a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.541 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad00a5ce0 con 0x7f5ad0133240 2024-09-16T06:47:58.541 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad0132aa0 con 0x7f5ad00a6dd0 2024-09-16T06:47:58.541 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0132d60 con 0x7f5ad0133620 2024-09-16T06:47:58.541 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad5fb1640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5ad0133240 0x7f5ad00a55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:44224/0 (socket says 172.21.15.96:44224) 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad5fb1640 1 -- 172.21.15.96:0/3036507921 learned_addr learned my addr 172.21.15.96:0/3036507921 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad57b0640 1 --2- 172.21.15.96:0/3036507921 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad00a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad67b2640 1 --2- 172.21.15.96:0/3036507921 >> v2:172.21.15.134:3300/0 conn(0x7f5ad00a6dd0 0x7f5ad00a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad4faf640 1 -- 172.21.15.96:0/3036507921 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856496671 0 0) 0x7f5ad00a5ce0 con 0x7f5ad0133240 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad4faf640 1 -- 172.21.15.96:0/3036507921 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5abc005740 con 0x7f5ad0133240 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad57b0640 1 -- 172.21.15.96:0/3036507921 >> v2:172.21.15.134:3300/0 conn(0x7f5ad00a6dd0 msgr2=0x7f5ad00a7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad57b0640 1 --2- 172.21.15.96:0/3036507921 >> v2:172.21.15.134:3300/0 conn(0x7f5ad00a6dd0 0x7f5ad00a7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad57b0640 1 -- 172.21.15.96:0/3036507921 >> v1:172.21.15.96:6789/0 conn(0x7f5ad0133240 legacy=0x7f5ad00a55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.542 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad57b0640 1 -- 172.21.15.96:0/3036507921 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad0133020 con 0x7f5ad0133620 2024-09-16T06:47:58.543 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad57b0640 1 --2- 172.21.15.96:0/3036507921 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad00a6890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00097c0 tx=0x7f5ac001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce816d57ec6291b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:58.543 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad4faf640 1 -- 172.21.15.96:0/3036507921 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00ab600 con 0x7f5ad0133620 2024-09-16T06:47:58.543 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad4faf640 1 -- 172.21.15.96:0/3036507921 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00a7050 con 0x7f5ad0133620 2024-09-16T06:47:58.544 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad4faf640 1 -- 172.21.15.96:0/3036507921 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00ab980 con 0x7f5ad0133620 2024-09-16T06:47:58.544 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 -- 172.21.15.96:0/3036507921 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 msgr2=0x7f5ad00a6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.545 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 --2- 172.21.15.96:0/3036507921 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad00a6890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00097c0 tx=0x7f5ac001c3f0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.545 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 -- 172.21.15.96:0/3036507921 shutdown_connections 2024-09-16T06:47:58.545 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 --2- 172.21.15.96:0/3036507921 >> v2:172.21.15.134:3300/0 conn(0x7f5ad00a6dd0 0x7f5ad00a7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.545 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 --2- 172.21.15.96:0/3036507921 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad00a6890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.545 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.538+0000 7f5ad8215640 1 -- 172.21.15.96:0/3036507921 >> 172.21.15.96:0/3036507921 conn(0x7f5ad006d410 msgr2=0x7f5ad006d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:58.545 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- 172.21.15.96:0/3036507921 shutdown_connections 2024-09-16T06:47:58.545 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- 172.21.15.96:0/3036507921 wait complete. 2024-09-16T06:47:58.547 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 Processor -- start 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- start start 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad00a6dd0 0x7f5ad0143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ad0133240 0x7f5ad013c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad013cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0140f60 con 0x7f5ad0133240 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0139740 con 0x7f5ad00a6dd0 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad013d3e0 con 0x7f5ad0133620 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ad0133240 0x7f5ad013c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad67b2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad013cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.548 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ad0133240 0x7f5ad013c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40776/0 (socket says 172.21.15.96:40776) 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 -- 172.21.15.96:0/1990853891 learned_addr learned my addr 172.21.15.96:0/1990853891 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad5fb1640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad00a6dd0 0x7f5ad0143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 -- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 msgr2=0x7f5ad013cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad013cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 -- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad00a6dd0 msgr2=0x7f5ad0143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad00a6dd0 0x7f5ad0143990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 -- 172.21.15.96:0/1990853891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0009420 con 0x7f5ad0133240 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad67b2640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad013cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad57b0640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ad0133240 0x7f5ad013c730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5ac001aaa0 tx=0x7f5ac0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00b5410 con 0x7f5ad0133240 2024-09-16T06:47:58.549 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00a4e90 con 0x7f5ad0133240 2024-09-16T06:47:58.550 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00b57d0 con 0x7f5ad0133240 2024-09-16T06:47:58.550 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad01441f0 con 0x7f5ad0133240 2024-09-16T06:47:58.550 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad0139ca0 con 0x7f5ad0133240 2024-09-16T06:47:58.550 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.542+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad00a7f30 con 0x7f5ad0133240 2024-09-16T06:47:58.551 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:58.543+0000 7f90f3b19180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 128979+0+0 (secure 0 0 0) 0x7f5ac00b2070 con 0x7f5ad0133240 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ac67fc640 20 mgrc handle_mgr_map mgrmap(e 13) v1 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ac67fc640 4 mgrc handle_mgr_map Got map version 13 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ac67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ac67fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ac67fc640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 0x7f5ab4099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ad5fb1640 1 -- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 msgr2=0x7f5ab4099e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4883+0+0 (secure 0 0 0) 0x7f5ac015a6f0 con 0x7f5ad0133240 2024-09-16T06:47:58.552 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.546+0000 7f5ad5fb1640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 0x7f5ab4099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:47:58.553 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.550+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ac0127a60 con 0x7f5ad0133240 2024-09-16T06:47:58.559 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:58.559+0000 7ff6fe2a2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:58.576 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:58.574+0000 7f27a1052180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T06:47:58.711 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.706+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"} v 0) v1 -- 0x7f5ad00715c0 con 0x7f5ad0133240 2024-09-16T06:47:58.715 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.710+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ac012b080 con 0x7f5ad0133240 2024-09-16T06:47:58.752 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.750+0000 7f5ad5fb1640 1 -- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 msgr2=0x7f5ab4099e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:58.752 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.750+0000 7f5ad5fb1640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 0x7f5ab4099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:47:58.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.802+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"} v 0) v1 -- 0x7f5ad00a3dc0 con 0x7f5ad0133240 2024-09-16T06:47:58.808 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ac67fc640 1 -- 172.21.15.96:0/1990853891 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/subtree"}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ac00b0020 con 0x7f5ad0133240 2024-09-16T06:47:58.812 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 10 mgrc shutdown 2024-09-16T06:47:58.812 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 msgr2=0x7f5ab4099e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:58.812 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 0x7f5ab4099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.812 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ad0133240 msgr2=0x7f5ad013c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.812 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ad0133240 0x7f5ad013c730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5ac001aaa0 tx=0x7f5ac0019190 comp rx=0 tx=0).stop 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 shutdown_connections 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f5ab4097960 0x7f5ab4099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ad0133240 0x7f5ad013c730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ad0133620 0x7f5ad013cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 --2- 172.21.15.96:0/1990853891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ad00a6dd0 0x7f5ad0143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 >> 172.21.15.96:0/1990853891 conn(0x7f5ad006d410 msgr2=0x7f5ad00a3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 shutdown_connections 2024-09-16T06:47:58.813 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.806+0000 7f5ad8215640 1 -- 172.21.15.96:0/1990853891 wait complete. 2024-09-16T06:47:58.826 INFO:tasks.workunit.client.0.smithi096.stderr:+ ceph config rm mgr mgr/localpool/failure_domain 2024-09-16T06:47:58.932 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.926+0000 7f1a6469f640 1 Processor -- start 2024-09-16T06:47:58.932 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6469f640 1 -- start start 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6469f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1a5c13f9f0 0x7f1a5c13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6469f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1a5c0a4d00 0x7f1a5c0a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6469f640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c143a10 con 0x7f1a5c0a5820 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6469f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c143820 con 0x7f1a5c13f9f0 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6469f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c0a6f30 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1a5c13f9f0 0x7f1a5c13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1a5c13f9f0 0x7f1a5c13fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40784/0 (socket says 172.21.15.96:40784) 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 -- 172.21.15.96:0/3589572606 learned_addr learned my addr 172.21.15.96:0/3589572606 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a61c3a640 1 --2- 172.21.15.96:0/3589572606 >> v2:172.21.15.134:3300/0 conn(0x7f1a5c0a4d00 0x7f1a5c0a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 -- 172.21.15.96:0/3589572606 >> v2:172.21.15.134:3300/0 conn(0x7f1a5c0a4d00 msgr2=0x7f1a5c0a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:58.934 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 --2- 172.21.15.96:0/3589572606 >> v2:172.21.15.134:3300/0 conn(0x7f1a5c0a4d00 0x7f1a5c0a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.935 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 -- 172.21.15.96:0/3589572606 >> v1:172.21.15.134:6789/0 conn(0x7f1a5c0a5820 legacy=0x7f1a5c0a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.935 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 -- 172.21.15.96:0/3589572606 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0a70a0 con 0x7f1a5c13f9f0 2024-09-16T06:47:58.936 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a6243b640 1 --2- 172.21.15.96:0/3589572606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 0x7f1a5c13fdd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0a7860 tx=0x7f1a5801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecbd4bf94cad547 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:58.936 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a61439640 1 -- 172.21.15.96:0/3589572606 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580a5600 con 0x7f1a5c13f9f0 2024-09-16T06:47:58.936 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a61439640 1 -- 172.21.15.96:0/3589572606 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0a8780 con 0x7f1a5c13f9f0 2024-09-16T06:47:58.936 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.930+0000 7f1a61439640 1 -- 172.21.15.96:0/3589572606 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580a5980 con 0x7f1a5c13f9f0 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- 172.21.15.96:0/3589572606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 msgr2=0x7f1a5c13fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 --2- 172.21.15.96:0/3589572606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 0x7f1a5c13fdd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0a7860 tx=0x7f1a5801c940 comp rx=0 tx=0).stop 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- 172.21.15.96:0/3589572606 shutdown_connections 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 --2- 172.21.15.96:0/3589572606 >> v2:172.21.15.134:3300/0 conn(0x7f1a5c0a4d00 0x7f1a5c0a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 --2- 172.21.15.96:0/3589572606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 0x7f1a5c13fdd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- 172.21.15.96:0/3589572606 >> 172.21.15.96:0/3589572606 conn(0x7f1a5c06d430 msgr2=0x7f1a5c06d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- 172.21.15.96:0/3589572606 shutdown_connections 2024-09-16T06:47:58.937 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- 172.21.15.96:0/3589572606 wait complete. 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 Processor -- start 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- start start 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a5c0a4d00 0x7f1a5c140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a5c0a5820 0x7f1a5c144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 0x7f1a5c1dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c070fe0 con 0x7f1a5c13f9f0 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c070890 con 0x7f1a5c0a5820 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0705d0 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a5c0a4d00 0x7f1a5c140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a5c0a4d00 0x7f1a5c140da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34510/0 (socket says 172.21.15.96:34510) 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 -- 172.21.15.96:0/1023649134 learned_addr learned my addr 172.21.15.96:0/1023649134 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:58.940 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a62c3c640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 0x7f1a5c1dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a61c3a640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a5c0a5820 0x7f1a5c144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 -- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a5c0a5820 msgr2=0x7f1a5c144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a5c0a5820 0x7f1a5c144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 -- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 msgr2=0x7f1a5c1dc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 0x7f1a5c1dc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 -- 172.21.15.96:0/1023649134 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a58009b30 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6243b640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a5c0a4d00 0x7f1a5c140da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a580af040 tx=0x7f1a580196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580b8880 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a580b8a00 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580b8db0 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c06fa60 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.941 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.934+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c145ae0 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.942 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c071280 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.942 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 13) v1 ==== 128979+0+0 (secure 0 0 0) 0x7f1a580ca430 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a52ffd640 20 mgrc handle_mgr_map mgrmap(e 13) v1 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a52ffd640 4 mgrc handle_mgr_map Got map version 13 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a52ffd640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 0x7f1a40099e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a61c3a640 1 -- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 msgr2=0x7f1a40099e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4883+0+0 (secure 0 0 0) 0x7f1a5815b960 con 0x7f1a5c0a4d00 2024-09-16T06:47:58.943 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.938+0000 7f1a61c3a640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 0x7f1a40099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T06:47:58.945 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:58.942+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1a58128e70 con 0x7f1a5c0a4d00 2024-09-16T06:47:59.035 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.031+0000 7f90f3b19180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:47:59.047 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:59.047+0000 7ff6fe2a2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:47:59.062 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:59.058+0000 7f27a1052180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T06:47:59.093 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.090+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"} v 0) v1 -- 0x7f1a5c144b60 con 0x7f1a5c0a4d00 2024-09-16T06:47:59.099 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.094+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"}]=0 v9) v1 ==== 111+0+0 (secure 0 0 0) 0x7f1a58009510 con 0x7f1a5c0a4d00 2024-09-16T06:47:59.109 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.107+0000 7f90f3b19180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:47:59.121 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:59.119+0000 7ff6fe2a2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:47:59.136 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:59.134+0000 7f27a1052180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T06:47:59.144 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.142+0000 7f1a61c3a640 1 -- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 msgr2=0x7f1a40099e20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.134:6824/200992303 2024-09-16T06:47:59.144 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.142+0000 7f1a61c3a640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 0x7f1a40099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T06:47:59.189 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.186+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"} v 0) v1 -- 0x7f1a5c0a7e30 con 0x7f1a5c0a4d00 2024-09-16T06:47:59.190 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.186+0000 7f1a52ffd640 1 -- 172.21.15.96:0/1023649134 <== mon.2 v2:172.21.15.96:3301/0 8 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/localpool/failure_domain"}]=0 v9) v1 ==== 111+0+0 (secure 0 0 0) 0x7f1a580bc020 con 0x7f1a5c0a4d00 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 10 mgrc shutdown 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 msgr2=0x7f1a40099e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 0x7f1a40099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a5c0a4d00 msgr2=0x7f1a5c140da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a5c0a4d00 0x7f1a5c140da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a580af040 tx=0x7f1a580196e0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 shutdown_connections 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:6824/200992303,v1:172.21.15.134:6825/200992303] conn(0x7f1a40097960 0x7f1a40099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1a5c13f9f0 0x7f1a5c1dc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a5c0a5820 0x7f1a5c144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 --2- 172.21.15.96:0/1023649134 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1a5c0a4d00 0x7f1a5c140da0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.194 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 >> 172.21.15.96:0/1023649134 conn(0x7f1a5c06d430 msgr2=0x7f1a5c0b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:59.195 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 shutdown_connections 2024-09-16T06:47:59.195 INFO:tasks.workunit.client.0.smithi096.stderr:2024-09-16T06:47:59.190+0000 7f1a6469f640 1 -- 172.21.15.96:0/1023649134 wait complete. 2024-09-16T06:47:59.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ echo OK 2024-09-16T06:47:59.209 INFO:tasks.workunit.client.0.smithi096.stdout:OK 2024-09-16T06:47:59.209 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T06:47:59.209 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T06:47:59.220 INFO:tasks.workunit:Stopping ['mgr/test_localpool.sh'] on client.0... 2024-09-16T06:47:59.220 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T06:47:59.258 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.255+0000 7f90f3b19180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:47:59.272 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:59.271+0000 7ff6fe2a2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:47:59.284 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:59.282+0000 7f27a1052180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T06:47:59.333 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.331+0000 7f90f3b19180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:47:59.350 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:59.347+0000 7ff6fe2a2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:47:59.361 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:59.358+0000 7f27a1052180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T06:47:59.529 DEBUG:teuthology.parallel:result is None 2024-09-16T06:47:59.529 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T06:47:59.584 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T06:47:59.584 DEBUG:teuthology.orchestra.run.smithi096:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T06:47:59.615 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.611+0000 7f90f3b19180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:47:59.633 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:59.631+0000 7ff6fe2a2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:47:59.643 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T06:47:59.643 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T06:47:59.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T06:47:59.653 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:59.642+0000 7f27a1052180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T06:47:59.669 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.667+0000 7f90f3b19180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:47:59.688 INFO:tasks.ceph.mgr.y.smithi134.stderr:2024-09-16T06:47:59.687+0000 7ff6fe2a2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:47:59.704 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-09-16T06:47:59.702+0000 7f27a1052180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T06:47:59.773 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907e090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907e090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907e090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907e090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907e090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907c08c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907c08c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907c08c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907c08c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.774 INFO:tasks.ceph.mgr.z.smithi134.stderr:2024-09-16T06:47:59.771+0000 7f907c08c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T06:47:59.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b706e640 1 Processor -- start 2024-09-16T06:47:59.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b706e640 1 -- start start 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b706e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe6b00a5d50 0x7fe6b00a7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b706e640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe6b013f650 0x7fe6b00a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b706e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b006abb0 con 0x7fe6b006a7d0 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b706e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b00a6160 con 0x7fe6b00a5d50 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b706e640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b00a7c90 con 0x7fe6b013f650 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6affff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe6b00a5d50 0x7fe6b00a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6affff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe6b00a5d50 0x7fe6b00a7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40796/0 (socket says 172.21.15.96:40796) 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6affff640 1 -- 172.21.15.96:0/3762656120 learned_addr learned my addr 172.21.15.96:0/3762656120 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6b560b640 1 --2- 172.21.15.96:0/3762656120 >> v2:172.21.15.134:3300/0 conn(0x7fe6b013f650 0x7fe6b00a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:59.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6affff640 1 -- 172.21.15.96:0/3762656120 >> v2:172.21.15.134:3300/0 conn(0x7fe6b013f650 msgr2=0x7fe6b00a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:47:59.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6affff640 1 --2- 172.21.15.96:0/3762656120 >> v2:172.21.15.134:3300/0 conn(0x7fe6b013f650 0x7fe6b00a6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6affff640 1 -- 172.21.15.96:0/3762656120 >> v1:172.21.15.96:6789/0 conn(0x7fe6b006a7d0 legacy=0x7fe6b013ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:59.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.778+0000 7fe6affff640 1 -- 172.21.15.96:0/3762656120 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b00a69d0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 --2- 172.21.15.96:0/3762656120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b00a7600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6b006add0 tx=0x7fe6a001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eedfd3e99638720 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:59.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6af7fe640 1 -- 172.21.15.96:0/3762656120 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00ad680 con 0x7fe6b00a5d50 2024-09-16T06:47:59.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6af7fe640 1 -- 172.21.15.96:0/3762656120 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a00ad7e0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6af7fe640 1 -- 172.21.15.96:0/3762656120 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00adb70 con 0x7fe6b00a5d50 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- 172.21.15.96:0/3762656120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 msgr2=0x7fe6b00a7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 --2- 172.21.15.96:0/3762656120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b00a7600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe6b006add0 tx=0x7fe6a001c3e0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- 172.21.15.96:0/3762656120 shutdown_connections 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 --2- 172.21.15.96:0/3762656120 >> v2:172.21.15.134:3300/0 conn(0x7fe6b013f650 0x7fe6b00a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 --2- 172.21.15.96:0/3762656120 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b00a7600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- 172.21.15.96:0/3762656120 >> 172.21.15.96:0/3762656120 conn(0x7fe6b00a4520 msgr2=0x7fe6b00a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- 172.21.15.96:0/3762656120 shutdown_connections 2024-09-16T06:47:59.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- 172.21.15.96:0/3762656120 wait complete. 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 Processor -- start 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- start start 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6b006a7d0 0x7fe6b0070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b013af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6b013f650 0x7fe6b013a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b014c110 con 0x7fe6b00a5d50 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b01462b0 con 0x7fe6b006a7d0 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b706e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b0146500 con 0x7fe6b013f650 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b013af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b560b640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6b013f650 0x7fe6b013a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:59.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b013af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40800/0 (socket says 172.21.15.96:40800) 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 -- 172.21.15.96:0/1802366533 learned_addr learned my addr 172.21.15.96:0/1802366533 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b4e0a640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6b006a7d0 0x7fe6b0070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 -- 172.21.15.96:0/1802366533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6b013f650 msgr2=0x7fe6b013a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6b013f650 0x7fe6b013a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 -- 172.21.15.96:0/1802366533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6b006a7d0 msgr2=0x7fe6b0070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6b006a7d0 0x7fe6b0070100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 -- 172.21.15.96:0/1802366533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a00094d0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6b4e0a640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6b006a7d0 0x7fe6b0070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6affff640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b013af60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0018ff0 tx=0x7fe6a001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00b8650 con 0x7fe6b00a5d50 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a00b87b0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.782+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00b8b20 con 0x7fe6b00a5d50 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b01467c0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b0070800 con 0x7fe6b00a5d50 2024-09-16T06:47:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b00a7600 con 0x7fe6b00a5d50 2024-09-16T06:47:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) v1 ==== 128588+0+0 (secure 0 0 0) 0x7fe6a00b4070 con 0x7fe6b00a5d50 2024-09-16T06:47:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6ad7fa640 20 mgrc handle_mgr_map mgrmap(e 14) v1 2024-09-16T06:47:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6ad7fa640 4 mgrc handle_mgr_map Got map version 14 2024-09-16T06:47:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6ad7fa640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:47:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6ad7fa640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:47:59.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.786+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe6a015a710 con 0x7fe6b00a5d50 2024-09-16T06:47:59.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.790+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe6a0127fa0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.950+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe6b0144e10 con 0x7fe6b00a5d50 2024-09-16T06:47:59.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.954+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe6a0127fa0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6ad7fa640 1 -- 172.21.15.96:0/1802366533 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe6a012b5c0 con 0x7fe6b00a5d50 2024-09-16T06:47:59.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 10 mgrc shutdown 2024-09-16T06:47:59.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 msgr2=0x7fe6b013af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b013af60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0018ff0 tx=0x7fe6a001ac20 comp rx=0 tx=0).stop 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 shutdown_connections 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6b00a5d50 0x7fe6b013af60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe6b013f650 0x7fe6b013a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 1 --2- 172.21.15.96:0/1802366533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6b006a7d0 0x7fe6b0070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.958+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 >> 172.21.15.96:0/1802366533 conn(0x7fe6b00a4520 msgr2=0x7fe6b0142510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.962+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 shutdown_connections 2024-09-16T06:47:59.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:47:59.962+0000 7fe6b706e640 1 -- 172.21.15.96:0/1802366533 wait complete. 2024-09-16T06:47:59.981 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T06:47:59.982 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T06:48:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c910e2640 1 Processor -- start 2024-09-16T06:48:00.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c910e2640 1 -- start start 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c910e2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c8c0a9310 0x7f0c8c147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c910e2640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0c8c0ab660 0x7f0c8c14de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c910e2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0a96f0 con 0x7f0c8c0abe20 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c910e2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0aa380 con 0x7f0c8c0a9310 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c910e2640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c139ee0 con 0x7f0c8c0ab660 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c8ad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c8c0a9310 0x7f0c8c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c8ad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c8c0a9310 0x7f0c8c147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40814/0 (socket says 172.21.15.96:40814) 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.094+0000 7f0c8ad9d640 1 -- 172.21.15.96:0/1287630592 learned_addr learned my addr 172.21.15.96:0/1287630592 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:00.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c8b59e640 1 --2- 172.21.15.96:0/1287630592 >> v2:172.21.15.134:3300/0 conn(0x7f0c8c0ab660 0x7f0c8c14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c8ad9d640 1 -- 172.21.15.96:0/1287630592 >> v2:172.21.15.134:3300/0 conn(0x7f0c8c0ab660 msgr2=0x7f0c8c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:00.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c8ad9d640 1 --2- 172.21.15.96:0/1287630592 >> v2:172.21.15.134:3300/0 conn(0x7f0c8c0ab660 0x7f0c8c14de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c8ad9d640 1 -- 172.21.15.96:0/1287630592 >> v1:172.21.15.96:6789/0 conn(0x7f0c8c0abe20 legacy=0x7f0c8c0aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c8ad9d640 1 -- 172.21.15.96:0/1287630592 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c146b10 con 0x7f0c8c0a9310 2024-09-16T06:48:00.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c8ad9d640 1 --2- 172.21.15.96:0/1287630592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c147320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0098a0 tx=0x7f0c7c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaf124c74f9d755 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:00.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c89d9b640 1 -- 172.21.15.96:0/1287630592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0ab600 con 0x7f0c8c0a9310 2024-09-16T06:48:00.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c89d9b640 1 -- 172.21.15.96:0/1287630592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c7c0a7050 con 0x7f0c8c0a9310 2024-09-16T06:48:00.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c89d9b640 1 -- 172.21.15.96:0/1287630592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0ab9a0 con 0x7f0c8c0a9310 2024-09-16T06:48:00.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 -- 172.21.15.96:0/1287630592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0a9310 msgr2=0x7f0c8c147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 --2- 172.21.15.96:0/1287630592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c147320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0098a0 tx=0x7f0c7c01c3c0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 -- 172.21.15.96:0/1287630592 shutdown_connections 2024-09-16T06:48:00.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 --2- 172.21.15.96:0/1287630592 >> v2:172.21.15.134:3300/0 conn(0x7f0c8c0ab660 0x7f0c8c14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 --2- 172.21.15.96:0/1287630592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c147320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 -- 172.21.15.96:0/1287630592 >> 172.21.15.96:0/1287630592 conn(0x7f0c8c06b4a0 msgr2=0x7f0c8c0a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:00.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 -- 172.21.15.96:0/1287630592 shutdown_connections 2024-09-16T06:48:00.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.098+0000 7f0c910e2640 1 -- 172.21.15.96:0/1287630592 wait complete. 2024-09-16T06:48:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 Processor -- start 2024-09-16T06:48:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 -- start start 2024-09-16T06:48:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0abe20 0x7f0c8c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c8c148ec0 0x7f0c8c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c144470 con 0x7f0c8c0abe20 2024-09-16T06:48:00.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c149750 con 0x7f0c8c0a9310 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c14a340 con 0x7f0c8c148ec0 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c8c148ec0 0x7f0c8c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0abe20 0x7f0c8c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c8c148ec0 0x7f0c8c06f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34528/0 (socket says 172.21.15.96:34528) 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 -- 172.21.15.96:0/101155333 learned_addr learned my addr 172.21.15.96:0/101155333 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8ad9d640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 -- 172.21.15.96:0/101155333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8c0a9310 msgr2=0x7f0c8c148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 -- 172.21.15.96:0/101155333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0abe20 msgr2=0x7f0c8c06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0abe20 0x7f0c8c06f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 -- 172.21.15.96:0/101155333 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0094d0 con 0x7f0c8c148ec0 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8ad9d640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c8b59e640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c8c148ec0 0x7f0c8c06f660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400cdc0 tx=0x7f0c8400a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:00.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c737fe640 1 -- 172.21.15.96:0/101155333 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84003ba0 con 0x7f0c8c148ec0 2024-09-16T06:48:00.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c737fe640 1 -- 172.21.15.96:0/101155333 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c84003d20 con 0x7f0c8c148ec0 2024-09-16T06:48:00.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c14a510 con 0x7f0c8c148ec0 2024-09-16T06:48:00.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c737fe640 1 -- 172.21.15.96:0/101155333 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84004280 con 0x7f0c8c148ec0 2024-09-16T06:48:00.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c06ffb0 con 0x7f0c8c148ec0 2024-09-16T06:48:00.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c14a6a0 con 0x7f0c8c148ec0 2024-09-16T06:48:00.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c737fe640 1 -- 172.21.15.96:0/101155333 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 14) v1 ==== 128588+0+0 (secure 0 0 0) 0x7f0c840043e0 con 0x7f0c8c148ec0 2024-09-16T06:48:00.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.102+0000 7f0c737fe640 20 mgrc handle_mgr_map mgrmap(e 14) v1 2024-09-16T06:48:00.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.106+0000 7f0c737fe640 4 mgrc handle_mgr_map Got map version 14 2024-09-16T06:48:00.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.106+0000 7f0c737fe640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:48:00.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.106+0000 7f0c737fe640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:48:00.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.106+0000 7f0c737fe640 1 -- 172.21.15.96:0/101155333 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0c84012070 con 0x7f0c8c148ec0 2024-09-16T06:48:00.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.110+0000 7f0c737fe640 1 -- 172.21.15.96:0/101155333 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c8408dcf0 con 0x7f0c8c148ec0 2024-09-16T06:48:00.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c8c147320 con 0x7f0c8c148ec0 2024-09-16T06:48:00.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c737fe640 1 -- 172.21.15.96:0/101155333 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f0c8408fc20 con 0x7f0c8c148ec0 2024-09-16T06:48:00.306 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:48:00.306 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6809/2274498401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2274498401},{"type":"v1","addr":"172.21.15.96:6809","nonce":2274498401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6811/2101624097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2101624097},{"type":"v1","addr":"172.21.15.96:6811","nonce":2101624097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T06:46:39.151294+0000","modified":"2024-09-16T06:46:41.789469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6827/3093802738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3093802738},{"type":"v1","addr":"172.21.15.134:6827","nonce":3093802738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-16T06:48:00.306 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-09-16T06:48:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 10 mgrc shutdown 2024-09-16T06:48:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c8c148ec0 msgr2=0x7f0c8c06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c8c148ec0 0x7f0c8c06f660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400cdc0 tx=0x7f0c8400a660 comp rx=0 tx=0).stop 2024-09-16T06:48:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 shutdown_connections 2024-09-16T06:48:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c8c0abe20 0x7f0c8c06f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0c8c148ec0 0x7f0c8c06f660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 --2- 172.21.15.96:0/101155333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0c8c0a9310 0x7f0c8c148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 >> 172.21.15.96:0/101155333 conn(0x7f0c8c06b4a0 msgr2=0x7f0c8c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:00.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 shutdown_connections 2024-09-16T06:48:00.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.302+0000 7f0c910e2640 1 -- 172.21.15.96:0/101155333 wait complete. 2024-09-16T06:48:00.325 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T06:48:00.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb40b9640 1 Processor -- start 2024-09-16T06:48:00.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb40b9640 1 -- start start 2024-09-16T06:48:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb40b9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1cac0a5990 0x7f1cac0a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb40b9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0a54e0 con 0x7f1cac0a5100 2024-09-16T06:48:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb40b9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cac0a43a0 con 0x7f1cac0a2390 2024-09-16T06:48:00.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb40b9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cac146cb0 con 0x7f1cac0a5990 2024-09-16T06:48:00.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb1654640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1cac0a5990 0x7f1cac0a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb1654640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1cac0a5990 0x7f1cac0a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40840/0 (socket says 172.21.15.96:40840) 2024-09-16T06:48:00.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb1654640 1 -- 172.21.15.96:0/759512242 learned_addr learned my addr 172.21.15.96:0/759512242 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:00.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb1654640 1 -- 172.21.15.96:0/759512242 >> v1:172.21.15.134:6789/0 conn(0x7f1cac0a2390 legacy=0x7f1cac14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:00.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb1654640 1 -- 172.21.15.96:0/759512242 >> v1:172.21.15.96:6789/0 conn(0x7f1cac0a5100 legacy=0x7f1cac1473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb1654640 1 -- 172.21.15.96:0/759512242 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac147ab0 con 0x7f1cac0a5990 2024-09-16T06:48:00.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb1654640 1 --2- 172.21.15.96:0/759512242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac0a6990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009870 tx=0x7f1ca801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58629d2402ed405 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb0e53640 1 -- 172.21.15.96:0/759512242 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80aa660 con 0x7f1cac0a5990 2024-09-16T06:48:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb0e53640 1 -- 172.21.15.96:0/759512242 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1ca80aa7c0 con 0x7f1cac0a5990 2024-09-16T06:48:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.442+0000 7f1cb0e53640 1 -- 172.21.15.96:0/759512242 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80aab70 con 0x7f1cac0a5990 2024-09-16T06:48:00.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/759512242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 msgr2=0x7f1cac0a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 --2- 172.21.15.96:0/759512242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac0a6990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009870 tx=0x7f1ca801c500 comp rx=0 tx=0).stop 2024-09-16T06:48:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/759512242 shutdown_connections 2024-09-16T06:48:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 --2- 172.21.15.96:0/759512242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac0a6990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/759512242 >> 172.21.15.96:0/759512242 conn(0x7f1cac06b8a0 msgr2=0x7f1cac0a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/759512242 shutdown_connections 2024-09-16T06:48:00.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/759512242 wait complete. 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 Processor -- start 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- start start 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cac0a2390 0x7f1cac1314d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1cac0a5100 0x7f1cac0997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac14e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac09a1a0 con 0x7f1cac0a5990 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac14bc80 con 0x7f1cac0a2390 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cac14bf40 con 0x7f1cac0a5100 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac14e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb1654640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1cac0a5100 0x7f1cac0997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac14e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40848/0 (socket says 172.21.15.96:40848) 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 -- 172.21.15.96:0/1083647873 learned_addr learned my addr 172.21.15.96:0/1083647873 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb1e55640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cac0a2390 0x7f1cac1314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 -- 172.21.15.96:0/1083647873 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1cac0a5100 msgr2=0x7f1cac0997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1cac0a5100 0x7f1cac0997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 -- 172.21.15.96:0/1083647873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cac0a2390 msgr2=0x7f1cac1314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cac0a2390 0x7f1cac1314d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 -- 172.21.15.96:0/1083647873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca80094d0 con 0x7f1cac0a5990 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb2656640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac14e530 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400c780 tx=0x7f1ca400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1ca27fc640 1 -- 172.21.15.96:0/1083647873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4003d90 con 0x7f1cac0a5990 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1ca27fc640 1 -- 172.21.15.96:0/1083647873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1ca400ce90 con 0x7f1cac0a5990 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1ca27fc640 1 -- 172.21.15.96:0/1083647873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40052d0 con 0x7f1cac0a5990 2024-09-16T06:48:00.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cac146980 con 0x7f1cac0a5990 2024-09-16T06:48:00.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cac14cf60 con 0x7f1cac0a5990 2024-09-16T06:48:00.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.446+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cac14adf0 con 0x7f1cac0a5990 2024-09-16T06:48:00.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.450+0000 7f1ca27fc640 1 -- 172.21.15.96:0/1083647873 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) v1 ==== 128588+0+0 (secure 0 0 0) 0x7f1ca4006b20 con 0x7f1cac0a5990 2024-09-16T06:48:00.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.450+0000 7f1ca27fc640 20 mgrc handle_mgr_map mgrmap(e 14) v1 2024-09-16T06:48:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.450+0000 7f1ca27fc640 4 mgrc handle_mgr_map Got map version 14 2024-09-16T06:48:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.450+0000 7f1ca27fc640 4 mgrc handle_mgr_map Active mgr is now 2024-09-16T06:48:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.450+0000 7f1ca27fc640 4 mgrc reconnect No active mgr available yet 2024-09-16T06:48:00.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.450+0000 7f1ca27fc640 1 -- 172.21.15.96:0/1083647873 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1ca40bf2b0 con 0x7f1cac0a5990 2024-09-16T06:48:00.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.454+0000 7f1ca27fc640 1 -- 172.21.15.96:0/1083647873 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ca408cab0 con 0x7f1cac0a5990 2024-09-16T06:48:00.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.634+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cac0a2cc0 con 0x7f1cac0a5990 2024-09-16T06:48:00.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1ca27fc640 1 -- 172.21.15.96:0/1083647873 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3975 (secure 0 0 0) 0x7f1ca408e9e0 con 0x7f1cac0a5990 2024-09-16T06:48:00.641 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:48:00.641 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6809/2274498401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2274498401},{"type":"v1","addr":"172.21.15.96:6809","nonce":2274498401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6811/2101624097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2101624097},{"type":"v1","addr":"172.21.15.96:6811","nonce":2101624097}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T06:46:39.151294+0000","modified":"2024-09-16T06:46:41.789469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4240},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4240":{"gid":4240,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6827/3093802738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3093802738},{"type":"v1","addr":"172.21.15.134:6827","nonce":3093802738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-16T06:48:00.641 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 10 mgrc shutdown 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 msgr2=0x7f1cac14e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac14e530 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400c780 tx=0x7f1ca400cc40 comp rx=0 tx=0).stop 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 shutdown_connections 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cac0a5990 0x7f1cac14e530 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1cac0a5100 0x7f1cac0997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 --2- 172.21.15.96:0/1083647873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1cac0a2390 0x7f1cac1314d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 >> 172.21.15.96:0/1083647873 conn(0x7f1cac06b8a0 msgr2=0x7f1cac0b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 shutdown_connections 2024-09-16T06:48:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.638+0000 7f1cb40b9640 1 -- 172.21.15.96:0/1083647873 wait complete. 2024-09-16T06:48:00.659 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T06:48:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.770+0000 7f6dd1fc9640 1 Processor -- start 2024-09-16T06:48:00.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.770+0000 7f6dd1fc9640 1 -- start start 2024-09-16T06:48:00.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6dcc0abe20 0x7f6dcc0aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc1396e0 0x7f6dcc0ab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc0a96f0 con 0x7f6dcc0a9310 2024-09-16T06:48:00.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc0aa380 con 0x7f6dcc0abe20 2024-09-16T06:48:00.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc139ee0 con 0x7f6dcc1396e0 2024-09-16T06:48:00.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc1396e0 0x7f6dcc0ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc1396e0 0x7f6dcc0ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34540/0 (socket says 172.21.15.96:34540) 2024-09-16T06:48:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 -- 172.21.15.96:0/3565733857 learned_addr learned my addr 172.21.15.96:0/3565733857 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcaffd640 1 --2- 172.21.15.96:0/3565733857 >> v2:172.21.15.134:3300/0 conn(0x7f6dcc0abe20 0x7f6dcc0aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 -- 172.21.15.96:0/3565733857 >> v2:172.21.15.134:3300/0 conn(0x7f6dcc0abe20 msgr2=0x7f6dcc0aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 --2- 172.21.15.96:0/3565733857 >> v2:172.21.15.134:3300/0 conn(0x7f6dcc0abe20 0x7f6dcc0aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 -- 172.21.15.96:0/3565733857 >> v1:172.21.15.134:6789/0 conn(0x7f6dcc0a9310 legacy=0x7f6dcc147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:00.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 -- 172.21.15.96:0/3565733857 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc146b10 con 0x7f6dcc1396e0 2024-09-16T06:48:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dcbfff640 1 --2- 172.21.15.96:0/3565733857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc1396e0 0x7f6dcc0ab490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009e50 tx=0x7f6dc401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61972b9d11059ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dca7fc640 1 -- 172.21.15.96:0/3565733857 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40a5530 con 0x7f6dcc1396e0 2024-09-16T06:48:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dca7fc640 1 -- 172.21.15.96:0/3565733857 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6dc40a5690 con 0x7f6dcc1396e0 2024-09-16T06:48:00.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dca7fc640 1 -- 172.21.15.96:0/3565733857 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40a5a40 con 0x7f6dcc1396e0 2024-09-16T06:48:00.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3565733857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc1396e0 msgr2=0x7f6dcc0ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3565733857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc1396e0 0x7f6dcc0ab490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009e50 tx=0x7f6dc401c8b0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3565733857 shutdown_connections 2024-09-16T06:48:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3565733857 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc1396e0 0x7f6dcc0ab490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3565733857 >> v2:172.21.15.134:3300/0 conn(0x7f6dcc0abe20 0x7f6dcc0aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3565733857 >> 172.21.15.96:0/3565733857 conn(0x7f6dcc06b4a0 msgr2=0x7f6dcc0a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3565733857 shutdown_connections 2024-09-16T06:48:00.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.774+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3565733857 wait complete. 2024-09-16T06:48:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 Processor -- start 2024-09-16T06:48:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 -- start start 2024-09-16T06:48:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dcc0a9310 0x7f6dcc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc0abe20 0x7f6dcc14b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc1396e0 0x7f6dcc06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc14b9d0 con 0x7f6dcc0a9310 2024-09-16T06:48:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1483e0 con 0x7f6dcc1396e0 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1486a0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc0abe20 0x7f6dcc14b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc0abe20 0x7f6dcc14b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34552/0 (socket says 172.21.15.96:34552) 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 -- 172.21.15.96:0/3460794870 learned_addr learned my addr 172.21.15.96:0/3460794870 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcb7fe640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dcc0a9310 0x7f6dcc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcbfff640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc1396e0 0x7f6dcc06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 -- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc1396e0 msgr2=0x7f6dcc06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc1396e0 0x7f6dcc06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 -- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dcc0a9310 msgr2=0x7f6dcc070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dcc0a9310 0x7f6dcc070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 -- 172.21.15.96:0/3460794870 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc4009b30 con 0x7f6dcc0abe20 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dcaffd640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc0abe20 0x7f6dcc14b340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6db400d800 tx=0x7f6db400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dc3fff640 1 -- 172.21.15.96:0/3460794870 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400b6c0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dc3fff640 1 -- 172.21.15.96:0/3460794870 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6db400b820 con 0x7f6dcc0abe20 2024-09-16T06:48:00.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc14c0a0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dc3fff640 1 -- 172.21.15.96:0/3460794870 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db400bbb0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc14cda0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.778+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc14bb40 con 0x7f6dcc0abe20 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dc3fff640 1 -- 172.21.15.96:0/3460794870 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 15) v1 ==== 128715+0+0 (secure 0 0 0) 0x7f6db400bd10 con 0x7f6dcc0abe20 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dc3fff640 20 mgrc handle_mgr_map mgrmap(e 15) v1 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dc3fff640 4 mgrc handle_mgr_map Got map version 15 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dc3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dc3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dc3fff640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f6dac097740 0x7f6dac099c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dc3fff640 1 -- 172.21.15.96:0/3460794870 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6db40c0dc0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dcb7fe640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f6dac097740 0x7f6dac099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:00.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.782+0000 7f6dcb7fe640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f6dac097740 0x7f6dac099c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc007fd0 tx=0x7f6dbc007e40 comp rx=0 tx=0).ready entity=mgr.4447 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:00.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.786+0000 7f6dc3fff640 1 -- 172.21.15.96:0/3460794870 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6db408e3e0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dcc0710c0 con 0x7f6dcc0abe20 2024-09-16T06:48:00.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dc3fff640 1 -- 172.21.15.96:0/3460794870 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14586 (secure 0 0 0) 0x7f6db4090310 con 0x7f6dcc0abe20 2024-09-16T06:48:00.938 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-09-16T06:48:00.938 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":30,"fsid":"63031869-dae1-491e-928d-826cedeb9570","created":"2024-09-16T06:46:15.669979+0000","modified":"2024-09-16T06:47:59.691727+0000","last_up_change":"2024-09-16T06:46:26.262436+0000","last_in_change":"2024-09-16T06:46:16.843452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T06:46:26.589352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T06:46:31.515422+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-09-16T06:46:37.467661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-09-16T06:46:38.139243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26c284cc-940d-494a-ac78-5af651c9336a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6801","nonce":3062669068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6803","nonce":3062669068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6807","nonce":3062669068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3062669068},{"type":"v1","addr":"172.21.15.96:6805","nonce":3062669068}]},"public_addr":"172.21.15.96:6801/3062669068","cluster_addr":"172.21.15.96:6803/3062669068","heartbeat_back_addr":"172.21.15.96:6807/3062669068","heartbeat_front_addr":"172.21.15.96:6805/3062669068","state":["exists","up"]},{"osd":1,"uuid":"955450ea-68e9-4215-985b-ce7892e1f2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6809","nonce":817883253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6811","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6813","nonce":817883253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6820","nonce":817883253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":817883253},{"type":"v1","addr":"172.21.15.134:6816","nonce":817883253}]},"public_addr":"172.21.15.134:6809/817883253","cluster_addr":"172.21.15.134:6813/817883253","heartbeat_back_addr":"172.21.15.134:6820/817883253","heartbeat_front_addr":"172.21.15.134:6816/817883253","state":["exists","up"]},{"osd":2,"uuid":"895d4d4e-f52e-4d47-99c5-63471daf0b7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6812","nonce":3839387097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6815","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6817","nonce":3839387097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6823","nonce":3839387097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6819","nonce":3839387097},{"type":"v1","addr":"172.21.15.134:6821","nonce":3839387097}]},"public_addr":"172.21.15.134:6812/3839387097","cluster_addr":"172.21.15.134:6817/3839387097","heartbeat_back_addr":"172.21.15.134:6823/3839387097","heartbeat_front_addr":"172.21.15.134:6821/3839387097","state":["exists","up"]},{"osd":3,"uuid":"23b8d56f-269e-401e-bb38-4a980a3def0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6801","nonce":1898754954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6803","nonce":1898754954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6807","nonce":1898754954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1898754954},{"type":"v1","addr":"172.21.15.134:6805","nonce":1898754954}]},"public_addr":"172.21.15.134:6801/1898754954","cluster_addr":"172.21.15.134:6803/1898754954","heartbeat_back_addr":"172.21.15.134:6807/1898754954","heartbeat_front_addr":"172.21.15.134:6805/1898754954","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.297933+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.440899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.462590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T06:46:22.417190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.1a","mappings":[{"from":0,"to":2}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.28","mappings":[{"from":0,"to":2}]},{"pgid":"4.3d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:0/4095363768":"2024-09-17T06:47:59.691688+0000","172.21.15.134:0/23035690":"2024-09-17T06:47:52.183364+0000","172.21.15.134:0/3033704333":"2024-09-17T06:47:59.691688+0000","172.21.15.134:0/3984602637":"2024-09-17T06:47:59.691688+0000","172.21.15.134:6824/468510839":"2024-09-17T06:47:52.183364+0000","172.21.15.134:0/2345075004":"2024-09-17T06:47:59.691688+0000","172.21.15.134:6825/468510839":"2024-09-17T06:47:52.183364+0000","172.21.15.134:6824/200992303":"2024-09-17T06:47:59.691688+0000","172.21.15.134:6825/200992303":"2024-09-17T06:47:59.691688+0000","172.21.15.134:0/4259638959":"2024-09-17T06:47:52.183364+0000","172.21.15.134:0/1607342520":"2024-09-17T06:47:52.183364+0000","172.21.15.134:0/4008004304":"2024-09-17T06:47:52.183364+0000","172.21.15.134:0/3856060453":"2024-09-17T06:47:59.691688+0000","172.21.15.134:0/3001964613":"2024-09-17T06:47:59.691688+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T06:48:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 10 mgrc shutdown 2024-09-16T06:48:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f6dac097740 msgr2=0x7f6dac099c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f6dac097740 0x7f6dac099c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc007fd0 tx=0x7f6dbc007e40 comp rx=0 tx=0).stop 2024-09-16T06:48:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc0abe20 msgr2=0x7f6dcc14b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc0abe20 0x7f6dcc14b340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6db400d800 tx=0x7f6db400dcc0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 shutdown_connections 2024-09-16T06:48:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f6dac097740 0x7f6dac099c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6dcc1396e0 0x7f6dcc06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6dcc0abe20 0x7f6dcc14b340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 --2- 172.21.15.96:0/3460794870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dcc0a9310 0x7f6dcc070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 >> 172.21.15.96:0/3460794870 conn(0x7f6dcc06b4a0 msgr2=0x7f6dcc14d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 shutdown_connections 2024-09-16T06:48:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:00.934+0000 7f6dd1fc9640 1 -- 172.21.15.96:0/3460794870 wait complete. 2024-09-16T06:48:00.956 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T06:48:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f1811695640 1 Processor -- start 2024-09-16T06:48:01.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f1811695640 1 -- start start 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f1811695640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f1811695640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f180c137b20 0x7f180c145410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f1811695640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c1449e0 con 0x7f180c0a5100 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f1811695640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c145950 con 0x7f180c137b20 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f1811695640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0a54e0 con 0x7f180c0a40e0 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f180a7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f180a7fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34554/0 (socket says 172.21.15.96:34554) 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f180a7fc640 1 -- 172.21.15.96:0/633578442 learned_addr learned my addr 172.21.15.96:0/633578442 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:01.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.066+0000 7f180b7fe640 1 --2- 172.21.15.96:0/633578442 >> v2:172.21.15.134:3300/0 conn(0x7f180c137b20 0x7f180c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f180a7fc640 1 -- 172.21.15.96:0/633578442 >> v2:172.21.15.134:3300/0 conn(0x7f180c137b20 msgr2=0x7f180c145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:01.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f180a7fc640 1 --2- 172.21.15.96:0/633578442 >> v2:172.21.15.134:3300/0 conn(0x7f180c137b20 0x7f180c145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f180a7fc640 1 -- 172.21.15.96:0/633578442 >> v1:172.21.15.134:6789/0 conn(0x7f180c0a5100 legacy=0x7f180c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f180a7fc640 1 -- 172.21.15.96:0/633578442 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c06d7b0 con 0x7f180c0a40e0 2024-09-16T06:48:01.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f180a7fc640 1 --2- 172.21.15.96:0/633578442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c144ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009870 tx=0x7f17fc01c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a812eac8439eef67 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:01.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1809ffb640 1 -- 172.21.15.96:0/633578442 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0ac600 con 0x7f180c0a40e0 2024-09-16T06:48:01.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1809ffb640 1 -- 172.21.15.96:0/633578442 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f17fc0a8050 con 0x7f180c0a40e0 2024-09-16T06:48:01.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1809ffb640 1 -- 172.21.15.96:0/633578442 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0ac9a0 con 0x7f180c0a40e0 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 -- 172.21.15.96:0/633578442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 msgr2=0x7f180c144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 --2- 172.21.15.96:0/633578442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c144ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009870 tx=0x7f17fc01c570 comp rx=0 tx=0).stop 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 -- 172.21.15.96:0/633578442 shutdown_connections 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 --2- 172.21.15.96:0/633578442 >> v2:172.21.15.134:3300/0 conn(0x7f180c137b20 0x7f180c145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 --2- 172.21.15.96:0/633578442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c144ed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 -- 172.21.15.96:0/633578442 >> 172.21.15.96:0/633578442 conn(0x7f180c06b8a0 msgr2=0x7f180c0a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 -- 172.21.15.96:0/633578442 shutdown_connections 2024-09-16T06:48:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.070+0000 7f1811695640 1 -- 172.21.15.96:0/633578442 wait complete. 2024-09-16T06:48:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 Processor -- start 2024-09-16T06:48:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 -- start start 2024-09-16T06:48:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c0a5100 0x7f180c1dc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f180c137b20 0x7f180c13e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c148b40 con 0x7f180c137b20 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c148680 con 0x7f180c0a5100 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c1dcdc0 con 0x7f180c0a40e0 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c0b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34568/0 (socket says 172.21.15.96:34568) 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 -- 172.21.15.96:0/2153473575 learned_addr learned my addr 172.21.15.96:0/2153473575 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180b7fe640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f180c137b20 0x7f180c13e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 -- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c0a5100 msgr2=0x7f180c1dc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c0a5100 0x7f180c1dc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 -- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f180c137b20 msgr2=0x7f180c13e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f180c137b20 0x7f180c13e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 -- 172.21.15.96:0/2153473575 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc0094d0 con 0x7f180c0a40e0 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180b7fe640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f180c137b20 0x7f180c13e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:48:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f180affd640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c0b29f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f180000c500 tx=0x7f180000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f17f37fe640 1 -- 172.21.15.96:0/2153473575 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800005220 con 0x7f180c0a40e0 2024-09-16T06:48:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f17f37fe640 1 -- 172.21.15.96:0/2153473575 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1800005380 con 0x7f180c0a40e0 2024-09-16T06:48:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c1dd080 con 0x7f180c0a40e0 2024-09-16T06:48:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f17f37fe640 1 -- 172.21.15.96:0/2153473575 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800007290 con 0x7f180c0a40e0 2024-09-16T06:48:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c0b53d0 con 0x7f180c0a40e0 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c147e90 con 0x7f180c0a40e0 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f17f37fe640 1 -- 172.21.15.96:0/2153473575 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 15) v1 ==== 128715+0+0 (secure 0 0 0) 0x7f18000073f0 con 0x7f180c0a40e0 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.074+0000 7f17f37fe640 20 mgrc handle_mgr_map mgrmap(e 15) v1 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f17f37fe640 4 mgrc handle_mgr_map Got map version 15 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f17f37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f17f37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f17f37fe640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f17f8097690 0x7f17f8099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f17f37fe640 1 -- 172.21.15.96:0/2153473575 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f18000c01a0 con 0x7f180c0a40e0 2024-09-16T06:48:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f180a7fc640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f17f8097690 0x7f17f8099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f180a7fc640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f17f8097690 0x7f17f8099b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0ae000 tx=0x7f17fc004740 comp rx=0 tx=0).ready entity=mgr.4447 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:01.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.078+0000 7f17f37fe640 1 -- 172.21.15.96:0/2153473575 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f180008d920 con 0x7f180c0a40e0 2024-09-16T06:48:01.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.266+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f180c147e70 con 0x7f180c0a40e0 2024-09-16T06:48:01.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.282+0000 7f17f37fe640 1 -- 172.21.15.96:0/2153473575 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1800090f40 con 0x7f180c0a40e0 2024-09-16T06:48:01.287 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T06:48:01.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 10 mgrc shutdown 2024-09-16T06:48:01.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f17f8097690 msgr2=0x7f17f8099b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f17f8097690 0x7f17f8099b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0ae000 tx=0x7f17fc004740 comp rx=0 tx=0).stop 2024-09-16T06:48:01.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 msgr2=0x7f180c0b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c0b29f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f180000c500 tx=0x7f180000c9c0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 shutdown_connections 2024-09-16T06:48:01.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f17f8097690 0x7f17f8099b50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f180c137b20 0x7f180c13e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f180c0a5100 0x7f180c1dc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 --2- 172.21.15.96:0/2153473575 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180c0a40e0 0x7f180c0b29f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 >> 172.21.15.96:0/2153473575 conn(0x7f180c06b8a0 msgr2=0x7f180c0a2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:01.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 shutdown_connections 2024-09-16T06:48:01.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.286+0000 7f1811695640 1 -- 172.21.15.96:0/2153473575 wait complete. 2024-09-16T06:48:01.292 INFO:tasks.ceph.mds.b.smithi134.stderr: -891> 2024-09-16T06:46:40.756+0000 7f22806e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T06:48:01.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T06:48:01.327 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-09-16T06:48:01.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f19a188e640 1 Processor -- start 2024-09-16T06:48:01.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f19a188e640 1 -- start start 2024-09-16T06:48:01.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f19a188e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06a5d0 0x7f199c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f19a188e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c06db30 con 0x7f199c069f40 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f19a188e640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c145ae0 con 0x7f199c06d700 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f19a188e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c06ad00 con 0x7f199c06a5d0 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06a5d0 0x7f199c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06a5d0 0x7f199c14d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34570/0 (socket says 172.21.15.96:34570) 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f199b7fe640 1 -- 172.21.15.96:0/1778001493 learned_addr learned my addr 172.21.15.96:0/1778001493 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f199affd640 1 --1- 172.21.15.96:0/1778001493 >> v1:172.21.15.96:6789/0 conn(0x7f199c069f40 0x7f199c144cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:44262/0 (socket says 172.21.15.96:44262) 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f199b7fe640 1 -- 172.21.15.96:0/1778001493 >> v1:172.21.15.134:6789/0 conn(0x7f199c06d700 legacy=0x7f199c1453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f1999ffb640 1 -- 172.21.15.96:0/1778001493 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690231251 0 0) 0x7f199c06db30 con 0x7f199c069f40 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f199b7fe640 1 -- 172.21.15.96:0/1778001493 >> v1:172.21.15.96:6789/0 conn(0x7f199c069f40 legacy=0x7f199c144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.410+0000 7f199b7fe640 1 -- 172.21.15.96:0/1778001493 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c06e840 con 0x7f199c06a5d0 2024-09-16T06:48:01.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 --2- 172.21.15.96:0/1778001493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06a5d0 0x7f199c14d210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f198c0098a0 tx=0x7f198c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c18694a1cf0f41a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:01.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f1999ffb640 1 -- 172.21.15.96:0/1778001493 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0ab660 con 0x7f199c06a5d0 2024-09-16T06:48:01.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f1999ffb640 1 -- 172.21.15.96:0/1778001493 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f198c0ab7c0 con 0x7f199c06a5d0 2024-09-16T06:48:01.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f1999ffb640 1 -- 172.21.15.96:0/1778001493 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0abb70 con 0x7f199c06a5d0 2024-09-16T06:48:01.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- 172.21.15.96:0/1778001493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06a5d0 msgr2=0x7f199c14d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 --2- 172.21.15.96:0/1778001493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06a5d0 0x7f199c14d210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f198c0098a0 tx=0x7f198c01c400 comp rx=0 tx=0).stop 2024-09-16T06:48:01.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- 172.21.15.96:0/1778001493 shutdown_connections 2024-09-16T06:48:01.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 --2- 172.21.15.96:0/1778001493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06a5d0 0x7f199c14d210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- 172.21.15.96:0/1778001493 >> 172.21.15.96:0/1778001493 conn(0x7f199c0a4520 msgr2=0x7f199c0a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:01.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- 172.21.15.96:0/1778001493 shutdown_connections 2024-09-16T06:48:01.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- 172.21.15.96:0/1778001493 wait complete. 2024-09-16T06:48:01.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 Processor -- start 2024-09-16T06:48:01.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- start start 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f199c069f40 0x7f199c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c06a5d0 0x7f199c1403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06d700 0x7f199c140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0a2c60 con 0x7f199c06a5d0 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c147880 con 0x7f199c069f40 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c147b00 con 0x7f199c06d700 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06d700 0x7f199c140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199a7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c06a5d0 0x7f199c1403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06d700 0x7f199c140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:34578/0 (socket says 172.21.15.96:34578) 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 -- 172.21.15.96:0/1009971162 learned_addr learned my addr 172.21.15.96:0/1009971162 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:01.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199a7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c06a5d0 0x7f199c1403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40880/0 (socket says 172.21.15.96:40880) 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 -- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f199c069f40 msgr2=0x7f199c0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f199c069f40 0x7f199c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 -- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c06a5d0 msgr2=0x7f199c1403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c06a5d0 0x7f199c1403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 -- 172.21.15.96:0/1009971162 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0094d0 con 0x7f199c06d700 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199a7fc640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c06a5d0 0x7f199c1403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f199b7fe640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06d700 0x7f199c140920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f198c0ad040 tx=0x7f198c01ac40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f1993fff640 1 -- 172.21.15.96:0/1009971162 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0b48c0 con 0x7f199c06d700 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f1993fff640 1 -- 172.21.15.96:0/1009971162 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f198c0b4a40 con 0x7f199c06d700 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c147dc0 con 0x7f199c06d700 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f1993fff640 1 -- 172.21.15.96:0/1009971162 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0b4e10 con 0x7f199c06d700 2024-09-16T06:48:01.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.414+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c14ce10 con 0x7f199c06d700 2024-09-16T06:48:01.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c14d4c0 con 0x7f199c06d700 2024-09-16T06:48:01.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f1993fff640 1 -- 172.21.15.96:0/1009971162 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 15) v1 ==== 128715+0+0 (secure 0 0 0) 0x7f198c0a9070 con 0x7f199c06d700 2024-09-16T06:48:01.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f1993fff640 20 mgrc handle_mgr_map mgrmap(e 15) v1 2024-09-16T06:48:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f1993fff640 4 mgrc handle_mgr_map Got map version 15 2024-09-16T06:48:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f1993fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f1993fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f1993fff640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f197c097690 0x7f197c099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f1993fff640 1 -- 172.21.15.96:0/1009971162 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5313+0+0 (secure 0 0 0) 0x7f198c15a890 con 0x7f199c06d700 2024-09-16T06:48:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f199affd640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f197c097690 0x7f197c099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.418+0000 7f199affd640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f197c097690 0x7f197c099b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1994000f90 tx=0x7f1994007c90 comp rx=0 tx=0).ready entity=mgr.4447 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:01.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.422+0000 7f1993fff640 1 -- 172.21.15.96:0/1009971162 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f198c127f20 con 0x7f199c06d700 2024-09-16T06:48:01.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:01.602+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f199c14d2e0 con 0x7f199c06d700 2024-09-16T06:48:02.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.302+0000 7f1993fff640 1 -- 172.21.15.96:0/1009971162 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f199c14d2e0 con 0x7f199c06d700 2024-09-16T06:48:02.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 10 mgrc shutdown 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f197c097690 msgr2=0x7f197c099b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f197c097690 0x7f197c099b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1994000f90 tx=0x7f1994007c90 comp rx=0 tx=0).stop 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06d700 msgr2=0x7f199c140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06d700 0x7f199c140920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f198c0ad040 tx=0x7f198c01ac40 comp rx=0 tx=0).stop 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 shutdown_connections 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7f197c097690 0x7f197c099b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f199c06a5d0 0x7f199c1403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f199c06d700 0x7f199c140920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 --2- 172.21.15.96:0/1009971162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f199c069f40 0x7f199c0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 >> 172.21.15.96:0/1009971162 conn(0x7f199c0a4520 msgr2=0x7f199c13af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 shutdown_connections 2024-09-16T06:48:02.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.306+0000 7f19a188e640 1 -- 172.21.15.96:0/1009971162 wait complete. 2024-09-16T06:48:02.332 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T06:48:02.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe1709e5640 1 Processor -- start 2024-09-16T06:48:02.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe1709e5640 1 -- start start 2024-09-16T06:48:02.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe1709e5640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe16c072dd0 0x7fe16c06dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe1709e5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c14de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe1709e5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c0731b0 con 0x7fe16c06e500 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe1709e5640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0b6640 con 0x7fe16c072dd0 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe1709e5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c06f670 con 0x7fe16c1431e0 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe16ad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe169d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe16c06e500 0x7fe16c142ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:60898/0 (socket says 172.21.15.96:60898) 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe169d9b640 1 -- 172.21.15.96:0/1768163960 learned_addr learned my addr 172.21.15.96:0/1768163960 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe16a59c640 1 --2- 172.21.15.96:0/1768163960 >> v2:172.21.15.134:3300/0 conn(0x7fe16c072dd0 0x7fe16c06dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe16959a640 1 -- 172.21.15.96:0/1768163960 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291743814 0 0) 0x7fe16c0731b0 con 0x7fe16c06e500 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe16ad9d640 1 -- 172.21.15.96:0/1768163960 >> v2:172.21.15.134:3300/0 conn(0x7fe16c072dd0 msgr2=0x7fe16c06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe16ad9d640 1 --2- 172.21.15.96:0/1768163960 >> v2:172.21.15.134:3300/0 conn(0x7fe16c072dd0 0x7fe16c06dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe16ad9d640 1 -- 172.21.15.96:0/1768163960 >> v1:172.21.15.96:6789/0 conn(0x7fe16c06e500 legacy=0x7fe16c142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:02.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.458+0000 7fe16ad9d640 1 -- 172.21.15.96:0/1768163960 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c06f930 con 0x7fe16c1431e0 2024-09-16T06:48:02.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 --2- 172.21.15.96:0/1768163960 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c14de70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe164009d90 tx=0x7fe16401c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49150da96615010f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:02.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16959a640 1 -- 172.21.15.96:0/1768163960 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640a58d0 con 0x7fe16c1431e0 2024-09-16T06:48:02.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16959a640 1 -- 172.21.15.96:0/1768163960 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe1640a5a30 con 0x7fe16c1431e0 2024-09-16T06:48:02.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16959a640 1 -- 172.21.15.96:0/1768163960 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640a5de0 con 0x7fe16c1431e0 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- 172.21.15.96:0/1768163960 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 msgr2=0x7fe16c14de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 --2- 172.21.15.96:0/1768163960 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c14de70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe164009d90 tx=0x7fe16401c810 comp rx=0 tx=0).stop 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- 172.21.15.96:0/1768163960 shutdown_connections 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 --2- 172.21.15.96:0/1768163960 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c14de70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 --2- 172.21.15.96:0/1768163960 >> v2:172.21.15.134:3300/0 conn(0x7fe16c072dd0 0x7fe16c06dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- 172.21.15.96:0/1768163960 >> 172.21.15.96:0/1768163960 conn(0x7fe16c06d090 msgr2=0x7fe16c0b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- 172.21.15.96:0/1768163960 shutdown_connections 2024-09-16T06:48:02.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- 172.21.15.96:0/1768163960 wait complete. 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 Processor -- start 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- start start 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16c06e500 0x7fe16c13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe16c072dd0 0x7fe16c141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0b6020 con 0x7fe16c06e500 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c140130 con 0x7fe16c072dd0 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe1709e5640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c1403f0 con 0x7fe16c1431e0 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:02.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16c06e500 0x7fe16c13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:45722/0 (socket says 172.21.15.96:45722) 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 -- 172.21.15.96:0/2482091487 learned_addr learned my addr 172.21.15.96:0/2482091487 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe169d9b640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe16c072dd0 0x7fe16c141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 -- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe16c072dd0 msgr2=0x7fe16c141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe16c072dd0 0x7fe16c141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 -- 172.21.15.96:0/2482091487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16c06e500 msgr2=0x7fe16c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16c06e500 0x7fe16c13ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 -- 172.21.15.96:0/2482091487 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009a70 con 0x7fe16c1431e0 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe169d9b640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe16c072dd0 0x7fe16c141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe16ad9d640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c141d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe16401aec0 tx=0x7fe1640195b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.462+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640b9860 con 0x7fe16c1431e0 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe1640b99c0 con 0x7fe16c1431e0 2024-09-16T06:48:02.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c1460e0 con 0x7fe16c1431e0 2024-09-16T06:48:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640b9d70 con 0x7fe16c1431e0 2024-09-16T06:48:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c145b90 con 0x7fe16c1431e0 2024-09-16T06:48:02.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c140d70 con 0x7fe16c1431e0 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 15) v1 ==== 128715+0+0 (secure 0 0 0) 0x7fe1640ad440 con 0x7fe16c1431e0 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 20 mgrc handle_mgr_map mgrmap(e 15) v1 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 4 mgrc handle_mgr_map Got map version 15 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fe14c097690 0x7fe14c099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5313+0+0 (secure 0 0 0) 0x7fe16415b6b0 con 0x7fe16c1431e0 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe16a59c640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fe14c097690 0x7fe14c099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:02.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.466+0000 7fe16a59c640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fe14c097690 0x7fe14c099b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe15c007a60 tx=0x7fe15c008040 comp rx=0 tx=0).ready entity=mgr.4447 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:02.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.470+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe164128d40 con 0x7fe16c1431e0 2024-09-16T06:48:02.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.630+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe16c06dfc0 con 0x7fe16c1431e0 2024-09-16T06:48:02.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.722+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mgrmap(e 16) v1 ==== 128923+0+0 (secure 0 0 0) 0x7fe164129110 con 0x7fe16c1431e0 2024-09-16T06:48:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.722+0000 7fe15affd640 20 mgrc handle_mgr_map mgrmap(e 16) v1 2024-09-16T06:48:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.722+0000 7fe15affd640 4 mgrc handle_mgr_map Got map version 16 2024-09-16T06:48:02.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:02.722+0000 7fe15affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:03.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.310+0000 7fe15affd640 1 -- 172.21.15.96:0/2482091487 <== mon.2 v2:172.21.15.96:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe1640f3010 con 0x7fe16c1431e0 2024-09-16T06:48:03.313 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 10 mgrc shutdown 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fe14c097690 msgr2=0x7fe14c099b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fe14c097690 0x7fe14c099b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe15c007a60 tx=0x7fe15c008040 comp rx=0 tx=0).stop 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 msgr2=0x7fe16c141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c141d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe16401aec0 tx=0x7fe1640195b0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 shutdown_connections 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fe14c097690 0x7fe14c099b50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe16c1431e0 0x7fe16c141d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe16c072dd0 0x7fe16c141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 --2- 172.21.15.96:0/2482091487 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe16c06e500 0x7fe16c13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 >> 172.21.15.96:0/2482091487 conn(0x7fe16c06d090 msgr2=0x7fe16c1435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:03.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 shutdown_connections 2024-09-16T06:48:03.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.314+0000 7fe1709e5640 1 -- 172.21.15.96:0/2482091487 wait complete. 2024-09-16T06:48:03.338 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T06:48:03.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 Processor -- start 2024-09-16T06:48:03.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 -- start start 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7b8133610 0x7fd7b80a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd7b80a6fe0 0x7fd7b806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8136b30 0x7fd7b806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b80a3970 con 0x7fd7b8133610 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b8132e60 con 0x7fd7b80a6fe0 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7bd82f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8132b30 con 0x7fd7b8136b30 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7b8133610 0x7fd7b80a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b77fe640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8136b30 0x7fd7b806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7b8133610 0x7fd7b80a6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48680/0 (socket says 172.21.15.96:48680) 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 -- 172.21.15.96:0/785913273 learned_addr learned my addr 172.21.15.96:0/785913273 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:03.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 -- 172.21.15.96:0/785913273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8136b30 msgr2=0x7fd7b806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:03.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 --2- 172.21.15.96:0/785913273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8136b30 0x7fd7b806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 -- 172.21.15.96:0/785913273 >> v2:172.21.15.134:3300/0 conn(0x7fd7b80a6fe0 msgr2=0x7fd7b806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T06:48:03.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 --2- 172.21.15.96:0/785913273 >> v2:172.21.15.134:3300/0 conn(0x7fd7b80a6fe0 0x7fd7b806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 -- 172.21.15.96:0/785913273 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b81339f0 con 0x7fd7b8133610 2024-09-16T06:48:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b6ffd640 1 --2- 172.21.15.96:0/785913273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8133610 0x7fd7b80a6aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80a54b0 tx=0x7fd7a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f72ac59c572287 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b5ffb640 1 -- 172.21.15.96:0/785913273 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80ab600 con 0x7fd7b8133610 2024-09-16T06:48:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b5ffb640 1 -- 172.21.15.96:0/785913273 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd7a80a7050 con 0x7fd7b8133610 2024-09-16T06:48:03.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.466+0000 7fd7b5ffb640 1 -- 172.21.15.96:0/785913273 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80ab9a0 con 0x7fd7b8133610 2024-09-16T06:48:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- 172.21.15.96:0/785913273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8133610 msgr2=0x7fd7b80a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/785913273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8133610 0x7fd7b80a6aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80a54b0 tx=0x7fd7a801c470 comp rx=0 tx=0).stop 2024-09-16T06:48:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- 172.21.15.96:0/785913273 shutdown_connections 2024-09-16T06:48:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/785913273 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8136b30 0x7fd7b806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/785913273 >> v2:172.21.15.134:3300/0 conn(0x7fd7b80a6fe0 0x7fd7b806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/785913273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8133610 0x7fd7b80a6aa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- 172.21.15.96:0/785913273 >> 172.21.15.96:0/785913273 conn(0x7fd7b80a4520 msgr2=0x7fd7b80a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:03.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- 172.21.15.96:0/785913273 shutdown_connections 2024-09-16T06:48:03.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- 172.21.15.96:0/785913273 wait complete. 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 Processor -- start 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- start start 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b80a6fe0 0x7fd7b80b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8133610 0x7fd7b8070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8136b30 0x7fd7b81df280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b81df0a0 con 0x7fd7b8136b30 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80712a0 con 0x7fd7b80a6fe0 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b813e8d0 con 0x7fd7b8133610 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b67fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8133610 0x7fd7b8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8136b30 0x7fd7b81df280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8136b30 0x7fd7b81df280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48694/0 (socket says 172.21.15.96:48694) 2024-09-16T06:48:03.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b67fc640 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8133610 0x7fd7b8070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:45732/0 (socket says 172.21.15.96:45732) 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 -- 172.21.15.96:0/2280778419 learned_addr learned my addr 172.21.15.96:0/2280778419 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b6ffd640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b80a6fe0 0x7fd7b80b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 -- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8133610 msgr2=0x7fd7b8070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8133610 0x7fd7b8070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 -- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b80a6fe0 msgr2=0x7fd7b80b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b80a6fe0 0x7fd7b80b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 -- 172.21.15.96:0/2280778419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a80094d0 con 0x7fd7b8136b30 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b67fc640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8133610 0x7fd7b8070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7b77fe640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8136b30 0x7fd7b81df280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000ef90 tx=0x7fd7b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0009ca0 con 0x7fd7b8136b30 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd7b000f040 con 0x7fd7b8136b30 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b8070390 con 0x7fd7b8136b30 2024-09-16T06:48:03.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00146e0 con 0x7fd7b8136b30 2024-09-16T06:48:03.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.470+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b81405e0 con 0x7fd7b8136b30 2024-09-16T06:48:03.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b8140300 con 0x7fd7b8136b30 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 128923+0+0 (secure 0 0 0) 0x7fd7b0014840 con 0x7fd7b8136b30 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd79ffff640 20 mgrc handle_mgr_map mgrmap(e 16) v1 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd79ffff640 4 mgrc handle_mgr_map Got map version 16 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd79ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd79ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd79ffff640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fd7a40978d0 0x7fd7a4099d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4875+0+0 (secure 0 0 0) 0x7fd7b00c1240 con 0x7fd7b8136b30 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd7b6ffd640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fd7a40978d0 0x7fd7a4099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T06:48:03.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.474+0000 7fd7b6ffd640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fd7a40978d0 0x7fd7a4099d90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80ad000 tx=0x7fd7a8008040 comp rx=0 tx=0).ready entity=mgr.4447 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T06:48:03.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.478+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7b008e650 con 0x7fd7b8136b30 2024-09-16T06:48:03.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:03.638+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd7b8140300 con 0x7fd7b8136b30 2024-09-16T06:48:04.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.346+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 17) v1 ==== 128979+0+0 (secure 0 0 0) 0x7fd7b008ea20 con 0x7fd7b8136b30 2024-09-16T06:48:04.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.346+0000 7fd79ffff640 20 mgrc handle_mgr_map mgrmap(e 17) v1 2024-09-16T06:48:04.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.346+0000 7fd79ffff640 4 mgrc handle_mgr_map Got map version 17 2024-09-16T06:48:04.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.346+0000 7fd79ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] 2024-09-16T06:48:04.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.346+0000 7fd79ffff640 1 -- 172.21.15.96:0/2280778419 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd7b00c35c0 con 0x7fd7b8136b30 2024-09-16T06:48:04.349 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-09-16T06:48:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 10 mgrc shutdown 2024-09-16T06:48:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fd7a40978d0 msgr2=0x7fd7a4099d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fd7a40978d0 0x7fd7a4099d90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80ad000 tx=0x7fd7a8008040 comp rx=0 tx=0).stop 2024-09-16T06:48:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8136b30 msgr2=0x7fd7b81df280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T06:48:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8136b30 0x7fd7b81df280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000ef90 tx=0x7fd7b000c490 comp rx=0 tx=0).stop 2024-09-16T06:48:04.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 shutdown_connections 2024-09-16T06:48:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:6824/2563474834,v1:172.21.15.134:6825/2563474834] conn(0x7fd7a40978d0 0x7fd7a4099d90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7b8136b30 0x7fd7b81df280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd7b8133610 0x7fd7b8070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 --2- 172.21.15.96:0/2280778419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7b80a6fe0 0x7fd7b80b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T06:48:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 >> 172.21.15.96:0/2280778419 conn(0x7fd7b80a4520 msgr2=0x7fd7b80a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T06:48:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 shutdown_connections 2024-09-16T06:48:04.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-09-16T06:48:04.354+0000 7fd7bd82f640 1 -- 172.21.15.96:0/2280778419 wait complete. 2024-09-16T06:48:04.376 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T06:48:04.376 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T06:48:04.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:04.386 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T06:48:04.386 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T06:48:04.386 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:04.443 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T06:48:04.444 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T06:48:04.444 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:04.457 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T06:48:04.458 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T06:48:04.458 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T06:48:04.458 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:06.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T06:48:10.560 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T06:48:10.560 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T06:48:10.560 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:10.624 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T06:48:10.624 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T06:48:10.624 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:11.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-16T06:48:11.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T06:48:16.725 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T06:48:16.726 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T06:48:16.726 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:16.781 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T06:48:16.781 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T06:48:16.782 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T06:48:16.782 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:16.815 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T06:48:16.815 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-16T06:48:16.815 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:16.843 INFO:tasks.ceph.mgr.y:Stopped 2024-09-16T06:48:16.844 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2024-09-16T06:48:16.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:16.917 INFO:tasks.ceph.mgr.z:Stopped 2024-09-16T06:48:16.917 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T06:48:16.917 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T06:48:16.917 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:16.941 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T06:48:16.941 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T06:48:16.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:17.004 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T06:48:17.004 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T06:48:17.004 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T06:48:17.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-16T06:48:17.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-16T06:48:17.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-16T06:48:17.027 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T06:48:17.027 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T06:48:17.027 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-16T06:48:17.067 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi096.front.sepia.ceph.com 2024-09-16T06:48:17.067 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T06:48:17.372 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:48:17.372 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T06:48:17.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:48:17.708 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T06:48:17.860 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:48:17.860 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T06:48:17.978 INFO:tasks.ceph:Archiving mon data... 2024-09-16T06:48:17.979 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/data/mon.a.tgz 2024-09-16T06:48:17.979 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-16T06:48:17.985 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.MJRdxnTZN4 2024-09-16T06:48:17.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MJRdxnTZN4 2024-09-16T06:48:18.194 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.MJRdxnTZN4 2024-09-16T06:48:18.257 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.MJRdxnTZN4 is 958KB 2024-09-16T06:48:18.322 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.MJRdxnTZN4 2024-09-16T06:48:18.328 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/data/mon.c.tgz 2024-09-16T06:48:18.328 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-09-16T06:48:18.376 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.5Zy8blS20A 2024-09-16T06:48:18.376 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5Zy8blS20A 2024-09-16T06:48:18.651 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.5Zy8blS20A 2024-09-16T06:48:18.712 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.5Zy8blS20A is 1MB 2024-09-16T06:48:18.783 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.5Zy8blS20A 2024-09-16T06:48:18.788 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/data/mon.b.tgz 2024-09-16T06:48:18.788 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-16T06:48:18.794 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.HMajCn83za 2024-09-16T06:48:18.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HMajCn83za 2024-09-16T06:48:19.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.HMajCn83za 2024-09-16T06:48:19.127 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.HMajCn83za is 1MB 2024-09-16T06:48:19.199 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.HMajCn83za 2024-09-16T06:48:19.204 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T06:48:19.205 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T06:48:19.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T06:48:19.259 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-16T06:48:19.259 DEBUG:teuthology.orchestra.run.smithi096:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-16T06:48:19.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-16T06:48:19.285 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-16T06:48:19.329 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-16T06:48:19.332 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T06:48:19.334 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/remote/smithi096/crash 2024-09-16T06:48:19.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T06:48:19.346 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/remote/smithi134/crash 2024-09-16T06:48:19.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T06:48:19.377 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:48:19.386 INFO:tasks.ceph:Shutting down logrotate 2024-09-16T06:48:19.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T06:48:19.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T06:48:19.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T06:48:19.517 INFO:tasks.ceph:Compressing logs... 2024-09-16T06:48:19.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T06:48:19.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T06:48:21.848 INFO:tasks.ceph:Archiving logs... 2024-09-16T06:48:21.848 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/remote/smithi096/log 2024-09-16T06:48:21.849 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T06:48:22.045 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/remote/smithi134/log 2024-09-16T06:48:22.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T06:48:22.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-16T06:48:22.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-16T06:48:22.297 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T06:48:22.306 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T06:48:22.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T06:48:22.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T06:48:22.383 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T06:48:22.392 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T06:48:22.392 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T06:48:22.394 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T06:48:22.406 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T06:48:22.406 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-09-16T06:48:22.406 INFO:teuthology.orchestra.run.smithi096.stdout:+hv01.front.sepi 67.205.162.81 3 u 60 64 17 0.115 -2.680 1.239 2024-09-16T06:48:22.406 INFO:teuthology.orchestra.run.smithi096.stdout:+hv02.front.sepi 63.231.80.2 3 u 55 64 17 0.081 +1.955 1.526 2024-09-16T06:48:22.406 INFO:teuthology.orchestra.run.smithi096.stdout:*hv03.front.sepi 74.6.168.72 3 u 52 64 17 0.118 -1.078 1.566 2024-09-16T06:48:22.407 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:48:22.408 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T06:48:22.408 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-16T06:48:22.408 INFO:teuthology.orchestra.run.smithi134.stdout:+hv01.front.sepi 67.205.162.81 3 u 57 64 17 0.193 -7.172 2.187 2024-09-16T06:48:22.408 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 17 0.133 -2.669 1.989 2024-09-16T06:48:22.408 INFO:teuthology.orchestra.run.smithi134.stdout:*hv03.front.sepi 74.6.168.72 3 u 51 64 17 0.135 -5.226 1.475 2024-09-16T06:48:22.409 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T06:48:22.409 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T06:48:22.417 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T06:48:22.417 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T06:48:22.431 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T06:48:22.440 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T06:48:22.449 INFO:teuthology.task.internal:Duration was 717.103378 seconds 2024-09-16T06:48:22.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T06:48:22.459 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T06:48:22.459 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T06:48:22.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T06:48:22.498 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T06:48:22.498 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-09-16T06:48:22.499 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T06:48:22.549 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T06:48:22.550 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T06:48:22.560 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T06:48:22.560 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T06:48:22.593 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T06:48:22.632 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T06:48:22.632 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T06:48:22.665 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T06:48:22.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T06:48:22.738 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T06:48:22.738 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T06:48:22.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T06:48:22.761 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T06:48:22.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T06:48:22.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T06:48:22.802 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-09-16T06:48:22.814 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-16T06:48:22.923 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T06:48:22.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:48:22.928 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T06:48:22.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T06:48:22.968 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T06:48:22.977 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T06:48:22.978 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/remote/smithi096 2024-09-16T06:48:22.978 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T06:48:23.001 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906574/remote/smithi134 2024-09-16T06:48:23.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T06:48:23.033 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T06:48:23.033 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T06:48:23.041 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T06:48:23.081 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T06:48:23.091 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T06:48:23.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T06:48:23.099 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T06:48:23.099 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T06:48:23.102 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T06:48:23.106 INFO:teuthology.orchestra.run.smithi096.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 06:48 /home/ubuntu/cephtest 2024-09-16T06:48:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: 658621 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 06:48 /home/ubuntu/cephtest 2024-09-16T06:48:23.130 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T06:48:23.140 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T06:48:23.160 INFO:teuthology.run:Summary data: description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/workunits} duration: 717.1033782958984 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T06:48:23.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T06:48:23.238 INFO:teuthology.run:pass